From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id CEC211F5AE for ; Tue, 8 Jun 2021 09:50:21 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/3] lei import: speedup repeated Maildir import Date: Tue, 8 Jun 2021 09:50:18 +0000 Message-Id: <20210608095021.20034-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: More importantly, this series starts us down the road of generalizing the use of auxiliary WQs like {ikw} (import keywords for IMAP) and {pmd} (parallel Maildir). It took me a bit to figure out some consistency problems which I reordered and split out into 1/3. 2/3 should make future work easier, and 3/3 gives the final speedup along the lines of what I already did with IMAP. Eric Wong (3): lei: safety fix for multiple WQ classes lei: generalize auxiliary WQ handling lei import: speed up repeated Maildir imports MANIFEST | 1 + lib/PublicInbox/LEI.pm | 20 ++++++++-- lib/PublicInbox/LeiBlob.pm | 2 +- lib/PublicInbox/LeiConvert.pm | 2 +- lib/PublicInbox/LeiExportKw.pm | 2 +- lib/PublicInbox/LeiImport.pm | 39 +++++++++++++------- lib/PublicInbox/LeiIndex.pm | 2 +- lib/PublicInbox/LeiInput.pm | 31 +++++++++++----- lib/PublicInbox/LeiLsSearch.pm | 2 +- lib/PublicInbox/LeiMailSync.pm | 14 +++++++ lib/PublicInbox/LeiMirror.pm | 4 +- lib/PublicInbox/LeiP2q.pm | 4 +- lib/PublicInbox/LeiPmdir.pm | 67 ++++++++++++++++++++++++++++++++++ lib/PublicInbox/LeiRediff.pm | 2 +- lib/PublicInbox/LeiRm.pm | 2 +- lib/PublicInbox/LeiTag.pm | 2 +- lib/PublicInbox/LeiXSearch.pm | 2 +- lib/PublicInbox/MdirReader.pm | 22 ++++++----- lib/PublicInbox/PktOp.pm | 6 --- t/lei-import-maildir.t | 2 +- 20 files changed, 171 insertions(+), 57 deletions(-) create mode 100644 lib/PublicInbox/LeiPmdir.pm