user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
From: Eric Wong <e@80x24.org>
To: Jonathan Nieder <jrnieder@gmail.com>
Cc: meta@public-inbox.org, Jeff King <peff@peff.net>
Subject: Re: Contributing messages to an archive
Date: Tue, 3 Jul 2018 19:54:44 +0000	[thread overview]
Message-ID: <20180703195444.c2oa4svg6azsaop3@dcvr> (raw)
In-Reply-To: <20180703160910.GB51821@aiede.svl.corp.google.com>

Jonathan Nieder <jrnieder@gmail.com> wrote:
> Hi Eric et al,
> 
> I dug through the documentation at public-inbox.org and didn't see a
> clear answer to this, so thought I'd ask to see whether my idea is
> crazy.
> 
> https://public-inbox.org/git contains a copy of all messages sent to
> the git mailing list, which is a useful resource for git developers.
> But some messages don't reach there:
> 
>  1. When vger has a bad day, some messages might not reach
>     public-inbox but they still reach any other developers that were
>     cc-ed

In that case, the notifying the admin(s) privately with an mbox
or whatever which I can drop into my Maildir watched by
public-inbox-watch should work fine[1].

>  2. (My motivation) The git-security@googlegroups.com list receives
>     messages about embargoed issues that should not be made public
>     right away.  We would like to switch to a model where after the
>     embargo expires, the discussion is made public.

I suspect that is best suited for a second archive.

It's simpler for readers using NNTP and Atom feeds to not get
out-of-date messages, and filtering rules[1] would be different,
as I suspect googlegroups allows HTML :<

Since I'm not a part of git-security, it might be best for you
and/or Jeff to run that yourselves[2].  I can help out, of
course.  I'd use public-inbox-watch setup to watch that a
particular Maildir, and you'd move unembargoed messages into
that.


> Is there a way to inject messages into the public-inbox.org/git
> archive?  E.g.  should I provide my own public-inbox style repository
> to pull messages from, or is there an address that I can bounce
> messages to?

If you're using public-inbox-watch, then dropping messages into
a Maildir being watched ought to do the trick.


There's also some one-off scripts in the scripts/ directory of
the git repo (e.g. scripts/import_vger_from_mbox) which can
work after-the-fact.


[1] If configured, PublicInbox::SaPlugin::ListMirror actually
    prevents bounced messages from being injected.  The admin would
    have to edit the top Received: header.

[2] The partitioned v2 layout I wrote for kernel.org scales way
    better than the original 2/38 layout.  Cloning is a little
    more involved (see the bottom of <https://lore.kernel.org/lkml/>),
    but the only difference is in setup is passing the "-V2" switch
    to public-inbox-init.  But yeah, remember being appalled by
    hosting costs of git-scm.com Peff posted, and public-inbox.org
    has always run on a $20/month VPS which I also hack and run
    test suites from.

  parent reply	other threads:[~2018-07-03 19:54 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-07-03 16:09 Contributing messages to an archive Jonathan Nieder
2018-07-03 16:39 ` Jeff King
2018-07-03 19:54 ` Eric Wong [this message]
2018-07-03 20:44   ` Jonathan Nieder
2018-07-03 21:00     ` Jeff King
2018-07-03 21:08       ` Eric Wong
2018-07-03 21:03     ` Eric Wong

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://public-inbox.org/README

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20180703195444.c2oa4svg6azsaop3@dcvr \
    --to=e@80x24.org \
    --cc=jrnieder@gmail.com \
    --cc=meta@public-inbox.org \
    --cc=peff@peff.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://80x24.org/public-inbox.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).