From: "Jon Smirl" <jonsmirl@gmail.com>
To: "Nicolas Pitre" <nico@cam.org>
Cc: "Martin Koegler" <mkoegler@auto.tuwien.ac.at>,
"Shawn O. Pearce" <spearce@spearce.org>,
"Git Mailing List" <git@vger.kernel.org>
Subject: Re: performance on repack
Date: Wed, 15 Aug 2007 15:42:51 -0400 [thread overview]
Message-ID: <9e4733910708151242q5ba020adkbe5d207f93be0f4c@mail.gmail.com> (raw)
In-Reply-To: <alpine.LFD.0.999.0708151453390.5415@xanadu.home>
On 8/15/07, Nicolas Pitre <nico@cam.org> wrote:
> On Wed, 15 Aug 2007, Jon Smirl wrote:
>
> > On 8/15/07, Martin Koegler <mkoegler@auto.tuwien.ac.at> wrote:
> > > git-pack-objects knows the order, in which it will use the objects. A
> > > seperate thread could pre-read the next object and wait until the main
> > > thread starts processing it. After the read is complete, another
> > > thread could start computing the delta index.
> >
> > The hope is that the new adaptive read ahead code in the kernel will
> > get this right and you won't need the second thread. Letting the
> > kernel handle the read ahead will dynamically scale as other demands
> > are made on the host. There's effectively only one read ahead cache in
> > the system, only the kernel really knows how to divide it up between
> > competing apps.
>
> No read ahead will ever help the delta search phase. Objects listed for
> deltification against each other are sorted in a way that results in
> reads from completely random location in the object store.
>
> Normally the delta search phase is so compute intensive that the read
> shouldn't matter much.
I agree, I am compute bound for 20 min, disk light occasionally dimly flickers.
Besides, the main thread that is preparing the queue effectively
functions as a read ahead thread. It will overlap with the compute
bound delta searches.
>
>
> Nicolas
>
--
Jon Smirl
jonsmirl@gmail.com
next prev parent reply other threads:[~2007-08-15 19:43 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2007-08-11 21:12 performance on repack Jon Smirl
2007-08-11 22:09 ` David Kastrup
2007-08-11 22:34 ` Linus Torvalds
2007-08-11 23:21 ` Jon Smirl
2007-08-12 10:33 ` Martin Koegler
2007-08-12 13:49 ` Jon Smirl
2007-08-14 3:12 ` Shawn O. Pearce
2007-08-14 4:10 ` Jon Smirl
2007-08-14 5:13 ` Shawn O. Pearce
2007-08-14 5:57 ` Jon Smirl
2007-08-14 14:52 ` Nicolas Pitre
2007-08-14 21:41 ` Nicolas Pitre
2007-08-15 1:20 ` Jon Smirl
2007-08-15 1:59 ` Nicolas Pitre
2007-08-15 5:32 ` Shawn O. Pearce
2007-08-15 15:08 ` Jon Smirl
2007-08-15 17:11 ` Martin Koegler
2007-08-15 18:38 ` Jon Smirl
2007-08-15 19:00 ` Nicolas Pitre
2007-08-15 19:42 ` Jon Smirl [this message]
2007-08-16 8:10 ` David Kastrup
2007-08-16 15:34 ` Nicolas Pitre
2007-08-16 16:13 ` Jon Smirl
2007-08-16 16:21 ` Nicolas Pitre
2007-08-15 21:05 ` Nicolas Pitre
2007-08-15 20:49 ` Nicolas Pitre
2007-08-30 4:27 ` Nicolas Pitre
2007-08-30 4:36 ` Nicolas Pitre
2007-08-30 16:17 ` Jon Smirl
2007-09-01 21:54 ` Jon Smirl
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: http://vger.kernel.org/majordomo-info.html
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=9e4733910708151242q5ba020adkbe5d207f93be0f4c@mail.gmail.com \
--to=jonsmirl@gmail.com \
--cc=git@vger.kernel.org \
--cc=mkoegler@auto.tuwien.ac.at \
--cc=nico@cam.org \
--cc=spearce@spearce.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).