* Understanding Index Header
@ 2018-10-06 21:13 Farhan Khan
2018-10-06 22:31 ` Kevin Daudt
0 siblings, 1 reply; 2+ messages in thread
From: Farhan Khan @ 2018-10-06 21:13 UTC (permalink / raw)
To: git
Hi all,
I am writing a program that parses out the .git/index file. I am
reading the git index header documentation, but I seem to be getting
jibberish data.
https://github.com/git/git/blob/master/Documentation/technical/index-format.txt
The first 12 bytes are the signature, version and entries. Great so far.
Afterwards, I try to read the extension signature, which the
documentation says: "4-byte extension signature. If the first byte is
'A'..'Z' the
extension is optional and can be ignored.". I am getting jibberish. Is
this expected?
Then, the extension size comes back as 35560000 (after ntohl()). That
seems extremely high. My structure is as follows:
struct _indexfile_hdr {
unsigned char sig[4]; /* Always "DIRC" */
uint32_t version; /* Version Number */
uint32_t entries; /* Number of extensions */
unsigned char extsig[4]; /* Extension signature */
uint32_t extsize; /* Size of the extension */
uint8_t sha[8]; /* SHA1 of index before checksum */
} __packed;
Am I doing something wrong? Is there some offset or padding that I missed?
Thanks,
--
Farhan Khan
PGP Fingerprint: B28D 2726 E2BC A97E 3854 5ABE 9A9F 00BC D525 16EE
^ permalink raw reply [flat|nested] 2+ messages in thread
* Re: Understanding Index Header
2018-10-06 21:13 Understanding Index Header Farhan Khan
@ 2018-10-06 22:31 ` Kevin Daudt
0 siblings, 0 replies; 2+ messages in thread
From: Kevin Daudt @ 2018-10-06 22:31 UTC (permalink / raw)
To: git
On Sat, Oct 06, 2018 at 05:13:45PM -0400, Farhan Khan wrote:
> Hi all,
>
> I am writing a program that parses out the .git/index file. I am
> reading the git index header documentation, but I seem to be getting
> jibberish data.
> https://github.com/git/git/blob/master/Documentation/technical/index-format.txt
>
> The first 12 bytes are the signature, version and entries. Great so far.
>
> Afterwards, I try to read the extension signature, which the
> documentation says: "4-byte extension signature. If the first byte is
> 'A'..'Z' the
> extension is optional and can be ignored.". I am getting jibberish. Is
> this expected?
>
> Then, the extension size comes back as 35560000 (after ntohl()). That
> seems extremely high. My structure is as follows:
>
> struct _indexfile_hdr {
> unsigned char sig[4]; /* Always "DIRC" */
> uint32_t version; /* Version Number */
> uint32_t entries; /* Number of extensions */
> unsigned char extsig[4]; /* Extension signature */
> uint32_t extsize; /* Size of the extension */
> uint8_t sha[8]; /* SHA1 of index before checksum */
> } __packed;
>
> Am I doing something wrong? Is there some offset or padding that I missed?
>
> Thanks,
> --
> Farhan Khan
Hello Farhan
Between the index header and the extensions there are index entries. So
you have 4 sections:
1. Header (fixed size)
2. Index entries (dynamic size, amount stored in the index)
3. Extensions (dynamic size)
4. hash
So you cannot capture the index with just a single struct. Also what you
call the 'entries' field is not the number of extensions, but the number
of index entries.
I'm not sure why you are seeing so many index entries. I've just tested
it myself on the git repository and I got 3419 entries when reading in
network (big-endian) order.
Hope this helps a bit.
Kevin
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2018-10-06 22:32 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-10-06 21:13 Understanding Index Header Farhan Khan
2018-10-06 22:31 ` Kevin Daudt
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).