user/dev discussion of public-inbox itself
 help / color / Atom feed
From: Eric Wong <e@80x24.org>
To: Ali Alnubani <alialnu@mellanox.com>
Cc: meta@public-inbox.org
Subject: Re: error: failed to run repack
Date: Wed, 12 Jun 2019 17:02:43 +0000
Message-ID: <20190612170243.f4azrhgylmjsq36y@dcvr> (raw)
In-Reply-To: <DB6PR0501MB216723738532D7D35FD4DECAD7EC0@DB6PR0501MB2167.eurprd05.prod.outlook.com>

Ali Alnubani <alialnu@mellanox.com> wrote:
> > -----Original Message-----
> > From: Eric Wong <e@80x24.org>
> > Sent: Tuesday, June 11, 2019 10:25 PM
> > To: Ali Alnubani <alialnu@mellanox.com>
> > Cc: meta@public-inbox.org
> > Subject: Re: error: failed to run repack
> > 
> > Ali Alnubani <alialnu@mellanox.com> wrote:
> > > Hi,
> > >
> > > I keep seeing the following in my logs for multiple lists:
> > >
> > > timestamp public-inbox-watch[PID]: Auto packing the repository in
> > background for optimum performance.
> > > timestamp public-inbox-watch[PID]: See "git help gc" for manual
> > housekeeping.
> > > timestamp public-inbox-watch[PID]: error: The last gc run reported the
> > > following. Please correct the root cause timestamp public-inbox-
> > watch[PID]: and remove path/to/repo.git/git/0.git/gc.log.
> > > timestamp public-inbox-watch[PID]: Automatic cleanup will not be
> > performed until the file is removed.
> > > timestamp public-inbox-watch[PID]: fatal: Failed to write bitmap
> > > index. Packfile doesn't have full closure (object
> > > 817390f628f74a55c627f1ddab8a44aa029753a0 is missing)
> > 
> > Do you have a path/to/repo.git/git/0.git/objects/info/alternates ?
> No:
> repo.git$ find . -name alternates
> ./all.git/objects/info/alternates

OK, thanks for that followup.  I wonder if there's something
else strange going on; or a git bug...

> > Bitmaps won't work when packing a repo with alternates In other words,
> > does 817390f628f74a55c627f1ddab8a44aa029753a0
> > exist in your 0.git, or somewhere else?
> This object doesn't exist in the filesystem:
> find . -name 817390f628f74a55c627f1ddab8a44aa029753a0
> But does exist as a commit in repo.git/git/0.git.

Erm, yeah, I just meant if it was in a pack somewhere, not a
loose object.

Did you have any crashes or failed fast-import processes?

> > The normal epoch repos (git/[0-9]+.git) aren't created with alternates by
> > default; instead all.git uses git/[0-9]+.git as alternates.
> Yes, this is the case in my repos.
> > 
> > > timestamp public-inbox-watch[PID]: error: failed to run repack
> > >
> > > Running 'git-fsck -full' in path/to/repo.git/git/0.git doesn't report any
> > issues.
> > >
> > > I imported my archives using scripts/import_vger_from_mbox.
> > >
> > > Any clue? Also is it safe to attempt a manual git-gc?
> > 
> > You might have the same result.  You can probably disable bitmaps in
> > all.git/config and set it in a git repo that does have full closure.
> 
> `git -c gc.reflogExpire=now gc --prune=all` inside repo.git/git/0.git finished successfully.
> Counting objects: 255747, done.
> Delta compression using up to 2 threads.
> Compressing objects: 100% (92077/92077), done.
> Writing objects: 100% (255747/255747), done.
> Reusing bitmaps: 256, done.
> Selecting bitmap commits: 83010, done.
> Building bitmaps: 100% (321/321), done.
> Total 255747 (delta 84903), reused 237858 (delta 78421)
> 
> repo.git/git/0.git$ git count-objects -Hv
> count: 0
> size: 0 bytes
> in-pack: 255747
> packs: 1
> size-pack: 121.41 MiB
> prune-packable: 0
> garbage: 0
> size-garbage: 0 bytes
>  
> I deleted the file gc.log afterwards. I will keep monitoring
> if gc fails and the file is created again.

OK, so everything works for now and I guess it's not easily
reproducible anymore?

Did the gc+prune expire commit 817390f628f74a55c627f1ddab8a44aa029753a0 ?

I'm also wondering if you used the new public-inbox-edit or
public-inbox-purge.

In the future, it would also be good to note the git version
in use and also to Cc: git@vger.kernel.org

      reply index

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-06-11 11:39 Ali Alnubani
2019-06-11 19:24 ` Eric Wong
2019-06-12 13:05   ` Ali Alnubani
2019-06-12 17:02     ` Eric Wong [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: http://public-inbox.org/README

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20190612170243.f4azrhgylmjsq36y@dcvr \
    --to=e@80x24.org \
    --cc=alialnu@mellanox.com \
    --cc=meta@public-inbox.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

user/dev discussion of public-inbox itself

Archives are clonable:
	git clone --mirror http://public-inbox.org/meta
	git clone --mirror http://czquwvybam4bgbro.onion/meta
	git clone --mirror http://hjrcffqmbrq6wope.onion/meta
	git clone --mirror http://ou63pmih66umazou.onion/meta

Example config snippet for mirrors

Newsgroups are available over NNTP:
	nntp://news.public-inbox.org/inbox.comp.mail.public-inbox.meta
	nntp://ou63pmih66umazou.onion/inbox.comp.mail.public-inbox.meta
	nntp://czquwvybam4bgbro.onion/inbox.comp.mail.public-inbox.meta
	nntp://hjrcffqmbrq6wope.onion/inbox.comp.mail.public-inbox.meta
	nntp://news.gmane.io/gmane.mail.public-inbox.general

 note: .onion URLs require Tor: https://www.torproject.org/

AGPL code for this site: git clone https://public-inbox.org/public-inbox.git