From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00
	shortcircuit=no autolearn=ham autolearn_force=no version=3.4.0
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id 569EC1F406;
	Mon, 15 Jan 2018 18:27:31 +0000 (UTC)
Date: Mon, 15 Jan 2018 18:27:31 +0000
From: Eric Wong <e@80x24.org>
To: Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Cc: meta@public-inbox.org
Subject: Re: Has anyone tried importing lkml?
Message-ID: <20180115182731.GA9768@80x24.org>
References: <d5546b24-5840-4ae9-d25b-5e3e737ed73b@linuxfoundation.org>
 <20180115175534.GA5787@80x24.org>
 <dd40474c-e468-584c-391e-1e9d252ff28c@linuxfoundation.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <dd40474c-e468-584c-391e-1e9d252ff28c@linuxfoundation.org>
List-Id: <meta.public-inbox.org>

Konstantin Ryabitsev <konstantin@linuxfoundation.org> wrote:
> Does frequent repacking with --write-bitmap-index help at all? The
> bitmaps usually dramatically improve cloning speeds for us.

Yes, but repacking itself is not easy.  Peff did some analysis
a while ago:

https://public-inbox.org/git/20160805092805.w3nwv2l6jkbuwlzf@sigill.intra.peff.net/

Storing object IDs in Xapian helps a lot avoid git graph/tree
lookup overheads for generating Atom feeds and such.

Also, does kernel.org have the complete archives anywhere?
I only have the last ~4 years or so.