From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.0 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 75D7F1F42D for ; Thu, 22 Mar 2018 09:40:15 +0000 (UTC) From: "Eric Wong (Contractor, The Linux Foundation)" To: meta@public-inbox.org Subject: [PATCH 00/13] reindexing, feeds, date fixes Date: Thu, 22 Mar 2018 09:40:02 +0000 Message-Id: <20180322094015.14422-1-e@80x24.org> Dae: Thu, 22 Mar 2018 09:30:43 +0000 List-Id: TODO: * fast-import/export filters (upgrades/purging) * update cloning instructions for v2 * Message-ID conflict support in web UI * Search SCHEMA_VERSION bump Eric Wong (Contractor, The Linux Foundation) (13): content_id: do not take Message-Id into account introduce InboxWritable class import: discard all the same headers as MDA InboxWritable: add mbox/maildir parsing + import logic use both Date: and Received: times msgmap: add tmp_clone to create an anonymous copy fix syntax warnings v2writable: support reindexing Xapian t/altid.t: extra tests for mid_set v2writable: add NNTP article number regeneration support v2writable: clarify header cleanups v2writable: DEBUG_DIFF respects $TMPDIR feed: $INBOX/new.atom endpoint supports v2 inboxes MANIFEST | 2 + lib/PublicInbox/ContentId.pm | 3 +- lib/PublicInbox/Daemon.pm | 2 +- lib/PublicInbox/EvCleanup.pm | 4 +- lib/PublicInbox/Feed.pm | 66 +++++++----- lib/PublicInbox/Import.pm | 29 +++-- lib/PublicInbox/Inbox.pm | 4 +- lib/PublicInbox/InboxWritable.pm | 160 ++++++++++++++++++++++++++++ lib/PublicInbox/MDA.pm | 2 - lib/PublicInbox/MsgTime.pm | 80 +++++++++----- lib/PublicInbox/Msgmap.pm | 53 +++++++++- lib/PublicInbox/Search.pm | 5 +- lib/PublicInbox/SearchIdx.pm | 20 +++- lib/PublicInbox/SearchIdxSkeleton.pm | 5 +- lib/PublicInbox/SearchMsg.pm | 28 ++--- lib/PublicInbox/SearchView.pm | 6 +- lib/PublicInbox/V2Writable.pm | 200 ++++++++++++++++++++++++++++++++--- lib/PublicInbox/View.pm | 30 +++--- lib/PublicInbox/WatchMaildir.pm | 69 +++--------- script/public-inbox-index | 56 ++++++++-- script/public-inbox-init | 6 +- scripts/import_vger_from_mbox | 51 ++------- t/altid.t | 11 +- t/msgmap.t | 4 + t/v2reindex.t | 98 +++++++++++++++++ t/v2writable.t | 10 +- 26 files changed, 764 insertions(+), 240 deletions(-) create mode 100644 lib/PublicInbox/InboxWritable.pm create mode 100644 t/v2reindex.t -- EW