From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id DA3911F4B4 for ; Wed, 23 Dec 2020 08:38:53 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 00/10] start optimizing startup w/ ALL->misc Date: Wed, 23 Dec 2020 08:38:43 +0000 Message-Id: <20201223083853.30721-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: -nntpd [PATCH 5/10] is the single most significant improvements. And some cleanups, and some general improvements independent of indexing in patches 7-10 (patch 8 is already superceded by 10, but kept separate for documentation purposes). PublicInbox::Config->new is over twice as fast, now. Eric Wong (10): miscsearch: load Xapian at initialization xt: add create-many-inboxes helper test inbox: git_epoch: correct false comment inboxwritable: _init_v1: set created_at ASAP miscsearch: index UIDVALIDITY, use as startup cache extsearchidx: close SQLite handles after attaching config: _fill: inbox name extraction optimization config: git_config_dump: pre-compile RE for split config: config_fh_parse: micro-optimize config: config_fh_parse: micro-optimize even harder MANIFEST | 1 + lib/PublicInbox/Config.pm | 26 ++++----- lib/PublicInbox/ExtSearchIdx.pm | 25 +++++--- lib/PublicInbox/Inbox.pm | 2 +- lib/PublicInbox/InboxWritable.pm | 3 +- lib/PublicInbox/MiscIdx.pm | 26 ++++++--- lib/PublicInbox/MiscSearch.pm | 57 ++++++++++++++++-- lib/PublicInbox/NNTPD.pm | 4 +- lib/PublicInbox/Search.pm | 9 ++- lib/PublicInbox/SearchIdx.pm | 7 --- t/search.t | 4 +- xt/create-many-inboxes.t | 99 ++++++++++++++++++++++++++++++++ 12 files changed, 213 insertions(+), 50 deletions(-) create mode 100644 xt/create-many-inboxes.t