user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
From: Eric Wong <e@80x24.org>
To: "Eric W. Biederman" <ebiederm@xmission.com>
Cc: meta@public-inbox.org
Subject: bug: v2 deletes on incremental fetch [was: Q: V2 format]
Date: Fri, 13 Jul 2018 22:02:59 +0000	[thread overview]
Message-ID: <20180713220259.GA27845@dcvr> (raw)
In-Reply-To: <878t6f1ch7.fsf@xmission.com>

"Eric W. Biederman" <ebiederm@xmission.com> wrote:
> Eric Wong <e@80x24.org> writes:
> > "Eric W. Biederman" <ebiederm@xmission.com> wrote:
> >> Then I am going to report a probable bug.  In V2 in public-inbox-index
> >> I can not find a path from finding a 'd' file and a call to unindex.  V1
> >> unindexes deleted files.  Rebased heads for purges call unindex.  I
> >> don't see that for ordinary d files though.
> >
> > It shouldn't need to call unindex because they never get indexed
> > on rebuilds.  V2 indexing walks history backwards (normal "git log"
> > behavior) so it remembers 'd' paths in the "$D" hash; and skips blobs
> > as it encounters them.
> >
> > v1 needed to unindex because it used "git log --reverse" to walk
> > forward in history.
> 
> This assumes that you see them in the same git pull.  I would think
> ideally anything that is going to be deleted that quickly you can just
> skip archiving.
> 
> What is the time window of you expecting 'd' messages to appear?

Ah, this is definitely a bug when using incremental fetch + -index.
Right now, it only warns on unseen entries in $D but won't reach
beyond the current "git log" window.

I'll take a lookg at it later today/this weekend unless you're
already working on it.

  parent reply	other threads:[~2018-07-13 22:02 UTC|newest]

Thread overview: 21+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-07-11 20:01 Q: V2 format Eric W. Biederman
2018-07-11 21:18 ` Konstantin Ryabitsev
2018-07-11 21:41   ` Eric W. Biederman
2018-07-12  1:47 ` Eric Wong
2018-07-12 13:58   ` Eric W. Biederman
2018-07-12 23:09     ` Eric Wong
2018-07-13 13:39       ` Eric W. Biederman
2018-07-13 20:03         ` Eric W. Biederman
2018-07-13 22:22           ` msgmap serial number regeneration [was: Q: V2 format] Eric Wong
2018-07-14 19:01             ` Eric W. Biederman
2018-07-15  3:18               ` Eric Wong
2018-07-16 15:20                 ` Eric W. Biederman
2018-07-13 22:02         ` Eric Wong [this message]
2018-07-13 22:51           ` bug: v2 deletes on incremental fetch " Eric W. Biederman
2018-07-14  0:46           ` [PATCH] v2writable: unindex deleted messages after incremental fetch Eric Wong
2018-07-13 23:07         ` IMAP server [was: Q: V2 format] Eric Wong
2018-07-13 23:12           ` Eric W. Biederman
2018-09-28 20:10           ` Johannes Berg
2018-09-28 21:01             ` Eric W. Biederman
2018-10-01  7:46               ` Johannes Berg
2018-10-01  8:51                 ` Eric W. Biederman

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://public-inbox.org/README

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20180713220259.GA27845@dcvr \
    --to=e@80x24.org \
    --cc=ebiederm@xmission.com \
    --cc=meta@public-inbox.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://80x24.org/public-inbox.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).