git@vger.kernel.org mailing list mirror (one of many)
 help / color / mirror / code / Atom feed
From: "Jon Smirl" <jonsmirl@gmail.com>
To: "Nicolas Pitre" <nico@cam.org>
Cc: "Shawn O. Pearce" <spearce@spearce.org>,
	"Martin Koegler" <mkoegler@auto.tuwien.ac.at>,
	"Git Mailing List" <git@vger.kernel.org>
Subject: Re: performance on repack
Date: Thu, 30 Aug 2007 12:17:26 -0400	[thread overview]
Message-ID: <9e4733910708300917w46d25c61n387e89dc3b2985f9@mail.gmail.com> (raw)
In-Reply-To: <alpine.LFD.0.999.0708300033540.16727@xanadu.home>

Practicing on the kernel, without the patch:
Q6600 with 4GB RAM

jonsmirl@terra:/home/linux$ time git repack -a -f --window=200 --depth=200
Generating pack...
Counting objects: 518288
Done counting 546466 objects.
Deltifying 546466 objects...
 100% (546466/546466) done
Writing 546466 objects...
 100% (546466/546466) done
Total 546466 (delta 452329), reused 0 (delta 0)
Pack pack-04c98effa112233951acbb2d8486eefac17a5a97 created.

real    16m27.752s
user    16m23.829s
sys     0m2.192s

With the patch it didn't balance very well. First two threads finished
in 2min, thrid in 5min, fourth in 10min.

So for fun I set it up to 16 threads, that kept all fours cores
running until the end. It added 1:20 in overhead, but it finished in
5m vs 16:30 unthreaded. Threading is an obvious win for this code.

jonsmirl@terra:/home/linux$ time git repack -a -f --window=200 --depth=200
Generating pack...
Counting objects: 502267
Done counting 546466 objects.
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
Deltifying 545660 objects...
   6% (34104/545660) done
   6% (34099/545660) done
   1% (6929/545660) donee
   5% (30037/545660) done
   6% (34101/545660) done
   4% (25222/545660) done
   6% (34102/545660) done
   3% (19999/545660) done
   6% (34102/545660) done
   4% (27203/545660) done
   6% (34102/545660) done
   4% (23377/545660) done
   6% (34042/545660) done
   6% (34099/545660) done
   6% (32740/545660) done


real    5m0.360s
user    17m41.822s
sys     0m5.596s
jonsmirl@terra:/home/linux$


-- 
Jon Smirl
jonsmirl@gmail.com

  reply	other threads:[~2007-08-30 16:17 UTC|newest]

Thread overview: 30+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-08-11 21:12 performance on repack Jon Smirl
2007-08-11 22:09 ` David Kastrup
2007-08-11 22:34   ` Linus Torvalds
2007-08-11 23:21     ` Jon Smirl
2007-08-12 10:33 ` Martin Koegler
2007-08-12 13:49   ` Jon Smirl
2007-08-14  3:12     ` Shawn O. Pearce
2007-08-14  4:10       ` Jon Smirl
2007-08-14  5:13         ` Shawn O. Pearce
2007-08-14  5:57           ` Jon Smirl
2007-08-14 14:52       ` Nicolas Pitre
2007-08-14 21:41       ` Nicolas Pitre
2007-08-15  1:20         ` Jon Smirl
2007-08-15  1:59           ` Nicolas Pitre
2007-08-15  5:32         ` Shawn O. Pearce
2007-08-15 15:08           ` Jon Smirl
2007-08-15 17:11             ` Martin Koegler
2007-08-15 18:38               ` Jon Smirl
2007-08-15 19:00                 ` Nicolas Pitre
2007-08-15 19:42                   ` Jon Smirl
2007-08-16  8:10                   ` David Kastrup
2007-08-16 15:34                     ` Nicolas Pitre
2007-08-16 16:13                       ` Jon Smirl
2007-08-16 16:21                         ` Nicolas Pitre
2007-08-15 21:05             ` Nicolas Pitre
2007-08-15 20:49           ` Nicolas Pitre
2007-08-30  4:27             ` Nicolas Pitre
2007-08-30  4:36               ` Nicolas Pitre
2007-08-30 16:17                 ` Jon Smirl [this message]
2007-09-01 21:54                 ` Jon Smirl

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: http://vger.kernel.org/majordomo-info.html

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=9e4733910708300917w46d25c61n387e89dc3b2985f9@mail.gmail.com \
    --to=jonsmirl@gmail.com \
    --cc=git@vger.kernel.org \
    --cc=mkoegler@auto.tuwien.ac.at \
    --cc=nico@cam.org \
    --cc=spearce@spearce.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://80x24.org/mirrors/git.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).