From mboxrd@z Thu Jan 1 00:00:00 1970 From: Nicolas Pitre Subject: Re: Git and GCC Date: Thu, 06 Dec 2007 09:18:39 -0500 (EST) Message-ID: References: <4aca3dc20712051947t5fbbb383ua1727c652eb25d7e@mail.gmail.com> <20071205.202047.58135920.davem@davemloft.net> <4aca3dc20712052032n521c344cla07a5df1f2c26cb8@mail.gmail.com> <20071205.204848.227521641.davem@davemloft.net> <4aca3dc20712052111o730f6fb6h7a329ee811a70f28@mail.gmail.com> <1196918132.10408.85.camel@brick> <4aca3dc20712052117j3ef5cf99y848d4962ae8ddf33@mail.gmail.com> <9e4733910712052247x116cabb4q48ebafffb93f7e03@mail.gmail.com> <20071206071503.GA19504@coredump.intra.peff.net> Mime-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Content-Transfer-Encoding: 7BIT Cc: Jon Smirl , Daniel Berlin , Harvey Harrison , David Miller , ismail@pardus.org.tr, gcc@gcc.gnu.org, git@vger.kernel.org To: Jeff King X-From: git-owner@vger.kernel.org Thu Dec 06 15:19:03 2007 Return-path: Envelope-to: gcvg-git-2@gmane.org Received: from vger.kernel.org ([209.132.176.167]) by lo.gmane.org with esmtp (Exim 4.50) id 1J0HZ7-0002tN-Jf for gcvg-git-2@gmane.org; Thu, 06 Dec 2007 15:19:02 +0100 Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752711AbXLFOSl (ORCPT ); Thu, 6 Dec 2007 09:18:41 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1752722AbXLFOSl (ORCPT ); Thu, 6 Dec 2007 09:18:41 -0500 Received: from relais.videotron.ca ([24.201.245.36]:38272 "EHLO relais.videotron.ca" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751592AbXLFOSk (ORCPT ); Thu, 6 Dec 2007 09:18:40 -0500 Received: from xanadu.home ([74.56.106.175]) by VL-MH-MR001.ip.videotron.ca (Sun Java(tm) System Messaging Server 6.3-4.01 (built Aug 3 2007; 32bit)) with ESMTP id <0JSM006ZST331S60@VL-MH-MR001.ip.videotron.ca> for git@vger.kernel.org; Thu, 06 Dec 2007 09:18:39 -0500 (EST) X-X-Sender: nico@xanadu.home In-reply-to: <20071206071503.GA19504@coredump.intra.peff.net> User-Agent: Alpine 0.99999 (LFD 814 2007-11-14) Sender: git-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Archived-At: On Thu, 6 Dec 2007, Jeff King wrote: > On Thu, Dec 06, 2007 at 01:47:54AM -0500, Jon Smirl wrote: > > > The key to converting repositories of this size is RAM. 4GB minimum, > > more would be better. git-repack is not multi-threaded. There were a > > few attempts at making it multi-threaded but none were too successful. > > If I remember right, with loads of RAM, a repack on a 450MB repository > > was taking about five hours on a 2.8Ghz Core2. But this is something > > you only have to do once for the import. Later repacks will reuse the > > original deltas. > > Actually, Nicolas put quite a bit of work into multi-threading the > repack process; the results have been in master for some time, and will > be in the soon-to-be-released v1.5.4. > > The downside is that the threading partitions the object space, so the > resulting size is not necessarily as small (but I don't know that > anybody has done testing on large repos to find out how large the > difference is). Quick guesstimate is in the 1% ballpark. Nicolas