From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.0 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 615FE1F404 for ; Wed, 4 Apr 2018 21:25:00 +0000 (UTC) From: "Eric Wong (Contractor, The Linux Foundation)" To: meta@public-inbox.org Subject: [PATCH 0/4] incremental indexing support for mirrors Date: Wed, 4 Apr 2018 21:24:56 +0000 Message-Id: <20180404212500.1859-1-e@80x24.org> List-Id: Incremental indexing is necessary for people running mirrors via "git-fetch", but not for people running inboxes with -watch or -mda. There's also bugfix for the corner case where several messages share a to-be-removed Message-ID. Eric Wong (Contractor, The Linux Foundation) (4): init: s/GIT_DIR/REPO_DIR/ in usage import: rewrite less history during purge v2: support incremental indexing + purge v2writable: do not modify DBs while iterating for ->remove MANIFEST | 1 + lib/PublicInbox/Import.pm | 28 ++-- lib/PublicInbox/Msgmap.pm | 5 + lib/PublicInbox/V2Writable.pm | 323 +++++++++++++++++++++++++++++++----------- script/public-inbox-convert | 2 +- script/public-inbox-index | 15 +- script/public-inbox-init | 2 +- t/v2mirror.t | 176 +++++++++++++++++++++++ t/v2reindex.t | 10 +- t/v2writable.t | 3 +- 10 files changed, 456 insertions(+), 109 deletions(-) create mode 100644 t/v2mirror.t -- EW