user/dev discussion of public-inbox itself
 help / color / Atom feed
* How to Extract public-inbox v2 to Maildir
@ 2020-04-26  4:37 Danh Doan
  2020-04-26  6:05 ` Eric Wong
  0 siblings, 1 reply; 4+ messages in thread
From: Danh Doan @ 2020-04-26  4:37 UTC (permalink / raw)
  To: meta

Hello public-inbox's developers,

I'm a happer user of ssoma.
I used to sync public-inbox's archive of git to a separate copy in
Maildir format in my local repository.

I see a move to lore.kernel.org/git for git archive, I tried to update
my ssoma configuration to point to lore.kernel.org.

To my surprise, it doesn't work because lore.kernel.org use version
2 of public-inbox's repository.

I tried to read both ssoma, and public-inbox documentation to figure
out it, but I have no luck.

Would it is easy (and desired) to have this in public-inbox, since
I saw a notice that ssoma won't support v2.

I think Email::LocalMailDelivery is the ways to go, but I haven't done
any Perl yet.

I would like to have a pointer, so I can implement this myself if
public-inbox don't want this feature.

-- 
Danh

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: How to Extract public-inbox v2 to Maildir
  2020-04-26  4:37 How to Extract public-inbox v2 to Maildir Danh Doan
@ 2020-04-26  6:05 ` Eric Wong
  2020-04-26  6:07   ` Eric Wong
  2020-04-26 14:19   ` Danh Doan
  0 siblings, 2 replies; 4+ messages in thread
From: Eric Wong @ 2020-04-26  6:05 UTC (permalink / raw)
  To: Danh Doan; +Cc: meta

Danh Doan <congdanhqx@gmail.com> wrote:
> To my surprise, it doesn't work because lore.kernel.org use version
> 2 of public-inbox's repository.

Right...

> Would it is easy (and desired) to have this in public-inbox, since
> I saw a notice that ssoma won't support v2.

If you like Maildir, there's l2md:
https://git.kernel.org/pub/scm/linux/kernel/git/dborkman/l2md.git/

I guess it'd be helpful to have a clients list in our
documentation somewhere...

Maybe I'll have time to work on some client tools, probably in
the vein of mairix where it'll dump search results into a
Maildir/mbox/IMAP folder.

Fwiw, I don't like Maildir for long-term storage at all, it's
fine for volatile inboxes, but has the same problems as loose
git objects which I don't like.

> I think Email::LocalMailDelivery is the ways to go, but I haven't done
> any Perl yet.

I'm moving away from the Email::* namespace since it's mostly
poorly-maintained, bloated, and unavailable from some distros.

More stuff is going in-tree, and Inline::C + liburing will be an
option for doing FS I/O :)

> I would like to have a pointer, so I can implement this myself if
> public-inbox don't want this feature.

I suggest l2md for now :)

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: How to Extract public-inbox v2 to Maildir
  2020-04-26  6:05 ` Eric Wong
@ 2020-04-26  6:07   ` Eric Wong
  2020-04-26 14:19   ` Danh Doan
  1 sibling, 0 replies; 4+ messages in thread
From: Eric Wong @ 2020-04-26  6:07 UTC (permalink / raw)
  To: Danh Doan; +Cc: meta

Eric Wong <e@yhbt.net> wrote:
> If you like Maildir, there's l2md:
> https://git.kernel.org/pub/scm/linux/kernel/git/dborkman/l2md.git/

Oh, there's also impibe:

	https://public-inbox.org/meta/87zhbcldi4.fsf@vuxu.org/

> I guess it'd be helpful to have a clients list in our
> documentation somewhere...

Yes, I'm scatter-brained :x

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: How to Extract public-inbox v2 to Maildir
  2020-04-26  6:05 ` Eric Wong
  2020-04-26  6:07   ` Eric Wong
@ 2020-04-26 14:19   ` Danh Doan
  1 sibling, 0 replies; 4+ messages in thread
From: Danh Doan @ 2020-04-26 14:19 UTC (permalink / raw)
  To: Eric Wong; +Cc: meta

On 2020-04-26 06:05:42+0000, Eric Wong <e@yhbt.net> wrote:
> Danh Doan <congdanhqx@gmail.com> wrote:
> > To my surprise, it doesn't work because lore.kernel.org use version
> > 2 of public-inbox's repository.
> 
> Right...
> 
> > Would it is easy (and desired) to have this in public-inbox, since
> > I saw a notice that ssoma won't support v2.
> 
> If you like Maildir, there's l2md:
> https://git.kernel.org/pub/scm/linux/kernel/git/dborkman/l2md.git/
> 
> I guess it'd be helpful to have a clients list in our
> documentation somewhere...
> 
> Maybe I'll have time to work on some client tools, probably in
> the vein of mairix where it'll dump search results into a
> Maildir/mbox/IMAP folder.
> 
> Fwiw, I don't like Maildir for long-term storage at all, it's
> fine for volatile inboxes, but has the same problems as loose
> git objects which I don't like.

Yes, it's scattered over filesystem, which harms performance.
But, at least, I can use notmuch with it.

Right now, I need to run public-inbox-nttpd to be able to read the
archive, and public-inbox-httpd to search.

> > I would like to have a pointer, so I can implement this myself if
> > public-inbox don't want this feature.
> 
> I suggest l2md for now :)

Thanks, I'll look into it.

-- 
Danh

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, back to index

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-04-26  4:37 How to Extract public-inbox v2 to Maildir Danh Doan
2020-04-26  6:05 ` Eric Wong
2020-04-26  6:07   ` Eric Wong
2020-04-26 14:19   ` Danh Doan

user/dev discussion of public-inbox itself

Archives are clonable:
	git clone --mirror http://public-inbox.org/meta
	git clone --mirror http://czquwvybam4bgbro.onion/meta
	git clone --mirror http://hjrcffqmbrq6wope.onion/meta
	git clone --mirror http://ou63pmih66umazou.onion/meta

Example config snippet for mirrors

Newsgroups are available over NNTP:
	nntp://news.public-inbox.org/inbox.comp.mail.public-inbox.meta
	nntp://ou63pmih66umazou.onion/inbox.comp.mail.public-inbox.meta
	nntp://czquwvybam4bgbro.onion/inbox.comp.mail.public-inbox.meta
	nntp://hjrcffqmbrq6wope.onion/inbox.comp.mail.public-inbox.meta
	nntp://news.gmane.io/gmane.mail.public-inbox.general

 note: .onion URLs require Tor: https://www.torproject.org/

AGPL code for this site: git clone https://public-inbox.org/public-inbox.git