From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 7AD7D1F8C8 for ; Fri, 24 Sep 2021 10:56:45 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/5] clone|fetch: flesh out partial mirror support Date: Fri, 24 Sep 2021 10:56:40 +0000 Message-Id: <20210924105645.8627-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: The --epoch=RANGE feature discussed last week[1] is implemented. There's also a bunch of fixes and improvements for handling partial fetches from work started last week. There's also a significant amount of work done to ensure the client-side code works on servers running old, pre-manifest versions of public-inbox. I'm not sure if there's pre-manifest.js.gz versions of public-inbox out there, but it's only ~2 years old and I can understand if some admins have been preoccupied with the pandemic and unable to upgrade :/ [1] https://public-inbox.org/meta/20210917002204.GA13112@dcvr/T/#u Eric Wong (5): clone|--mirror: support --epoch=RANGE for partial clones fetch: fix skipping with multi-epoch inboxes clone|--mirror: fix and test against pre-manifest WWW clone|fetch|--mirror: cull manifest in partial mirrors fetch: support v2 w/o manifest on old WWW Documentation/lei-add-external.pod | 15 +++ Documentation/public-inbox-clone.pod | 15 +++ lib/PublicInbox/Fetch.pm | 27 ++++-- lib/PublicInbox/LEI.pm | 2 +- lib/PublicInbox/LeiMirror.pm | 130 +++++++++++++++++++++++--- lib/PublicInbox/TestCommon.pm | 1 + script/public-inbox-clone | 3 +- t/lei-mirror.t | 8 ++ t/v2mirror.t | 135 +++++++++++++++++++++++++-- 9 files changed, 306 insertions(+), 30 deletions(-)