From: Eric Wong <e@80x24.org>
To: meta@public-inbox.org
Subject: [PATCH 0/7] new public-inbox-{clone,fetch} commands
Date: Sun, 12 Sep 2021 07:47:09 +0000 [thread overview]
Message-ID: <20210912074716.4713-1-e@80x24.org> (raw)
Hopefully, these new commands make maintaining mirrors of a
single (or handful of) multi-epoch v2 inboxes easier and less
error-prone.
Unlike grokmirror:
* these commands do not require extra config files of any kind
* they only allow cloning/fetching a single inbox per-invocation
"description" files also default to something more meaningful
for both public-inbox-init and -clone.
PATCH 7/7 also begins laying the groundwork for a v1 => v2
migration path which doesn't involve existing mirrors
having to redownload everything.
Eric Wong (7):
lei_mirror: simplify error reporting
lei_mirror: fix error message
new public-inbox-{clone,fetch} commands
clone|lei_mirror: write description in mirrors
import: do not write a "description" file
init: set a useful description
fetch: use manifest.js.gz for v1
Documentation/public-inbox-clone.pod | 71 +++++++++++
Documentation/public-inbox-fetch.pod | 63 ++++++++++
MANIFEST | 5 +
lib/PublicInbox/Admin.pm | 8 ++
lib/PublicInbox/Fetch.pm | 172 +++++++++++++++++++++++++++
lib/PublicInbox/Import.pm | 3 -
lib/PublicInbox/LEI.pm | 6 +-
lib/PublicInbox/LeiMirror.pm | 167 ++++++++++++++++----------
lib/PublicInbox/TestCommon.pm | 3 +-
script/public-inbox-clone | 58 +++++++++
script/public-inbox-fetch | 35 ++++++
script/public-inbox-init | 6 +
t/init.t | 3 +
t/lei-mirror.t | 52 ++++++++
t/www_listing.t | 1 -
15 files changed, 585 insertions(+), 68 deletions(-)
create mode 100644 Documentation/public-inbox-clone.pod
create mode 100644 Documentation/public-inbox-fetch.pod
create mode 100644 lib/PublicInbox/Fetch.pm
create mode 100755 script/public-inbox-clone
create mode 100755 script/public-inbox-fetch
next reply other threads:[~2021-09-12 7:47 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-09-12 7:47 Eric Wong [this message]
2021-09-12 7:47 ` [PATCH 1/7] lei_mirror: simplify error reporting Eric Wong
2021-09-12 7:47 ` [PATCH 2/7] lei_mirror: fix error message Eric Wong
2021-09-12 7:47 ` [PATCH 3/7] new public-inbox-{clone,fetch} commands Eric Wong
2021-09-12 7:47 ` [PATCH 4/7] clone|lei_mirror: write description in mirrors Eric Wong
2021-09-12 7:47 ` [PATCH 5/7] import: do not write a "description" file Eric Wong
2021-09-12 7:47 ` [PATCH 6/7] init: set a useful description Eric Wong
2021-09-12 7:47 ` [PATCH 7/7] fetch: use manifest.js.gz for v1 Eric Wong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://public-inbox.org/README
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210912074716.4713-1-e@80x24.org \
--to=e@80x24.org \
--cc=meta@public-inbox.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://80x24.org/public-inbox.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).