user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download mbox.gz: |
* [PATCH] add scripts/xhdr-num2mid example
@ 2016-07-28 22:01  7% Eric Wong
  0 siblings, 0 replies; 1+ results
From: Eric Wong @ 2016-07-28 22:01 UTC (permalink / raw)
  To: meta

This is used to quickly generate an article number to Message-ID
mapping.

Usage:

NNTPSERVER=news.example.org ./scripts/xhdr-num2mid GROUP >file
---
 MANIFEST             |  1 +
 scripts/xhdr-num2mid | 30 ++++++++++++++++++++++++++++++
 2 files changed, 31 insertions(+)
 create mode 100755 scripts/xhdr-num2mid

diff --git a/MANIFEST b/MANIFEST
index 297301d..308da06 100644
--- a/MANIFEST
+++ b/MANIFEST
@@ -102,6 +102,7 @@ scripts/import_vger_from_mbox
 scripts/report-spam
 scripts/slrnspool2maildir
 scripts/ssoma-replay
+scripts/xhdr-num2mid
 t/address.t
 t/cgi.t
 t/check-www-inbox.perl
diff --git a/scripts/xhdr-num2mid b/scripts/xhdr-num2mid
new file mode 100755
index 0000000..f1e7ea3
--- /dev/null
+++ b/scripts/xhdr-num2mid
@@ -0,0 +1,30 @@
+#!/usr/bin/perl -w
+# Copyright (C) 2016 all contributors <meta@public-inbox.org>
+# License: AGPL-3.0+ <https://www.gnu.org/licenses/agpl-3.0.txt>
+# Useful for mapping article IDs from existing NNTP servers to MIDs
+use strict;
+use warnings;
+use Net::NNTP;
+use Data::Dumper;
+my $usage = "usage: NNTPSERVER=news.example.org $0 GROUP [FIRST_NUM]\n";
+my $group = shift or die $usage;
+my $nntp = Net::NNTP->new($ENV{NNTPSERVER} || '127.0.0.1');
+my ($num, $first, $last) = $nntp->group($group);
+die "Invalid group\n" if !(defined $num && defined $first && defined $last);
+my $arg_first = shift;
+if (defined $arg_first) {
+	$arg_first =~ /\A\d+\z/ or die $usage;
+	$first = $arg_first;
+}
+
+my $batch = 1000;
+my $i;
+for ($i = $first; $i < $last; $i += $batch) {
+	my $j = $i + $batch;
+	$j = $last if $j > $last;
+	my $num2mid = $nntp->xhdr('Message-ID', "$i-$j");
+	for my $n ($i..$j) {
+		defined(my $mid = $num2mid->{$n}) or next;
+		print "$n $mid\n";
+	}
+}
-- 
@@ -0,0 +1,30 @@
+#!/usr/bin/perl -w
+# Copyright (C) 2016 all contributors <meta@public-inbox.org>
+# License: AGPL-3.0+ <https://www.gnu.org/licenses/agpl-3.0.txt>
+# Useful for mapping article IDs from existing NNTP servers to MIDs
+use strict;
+use warnings;
+use Net::NNTP;
+use Data::Dumper;
+my $usage = "usage: NNTPSERVER=news.example.org $0 GROUP [FIRST_NUM]\n";
+my $group = shift or die $usage;
+my $nntp = Net::NNTP->new($ENV{NNTPSERVER} || '127.0.0.1');
+my ($num, $first, $last) = $nntp->group($group);
+die "Invalid group\n" if !(defined $num && defined $first && defined $last);
+my $arg_first = shift;
+if (defined $arg_first) {
+	$arg_first =~ /\A\d+\z/ or die $usage;
+	$first = $arg_first;
+}
+
+my $batch = 1000;
+my $i;
+for ($i = $first; $i < $last; $i += $batch) {
+	my $j = $i + $batch;
+	$j = $last if $j > $last;
+	my $num2mid = $nntp->xhdr('Message-ID', "$i-$j");
+	for my $n ($i..$j) {
+		defined(my $mid = $num2mid->{$n}) or next;
+		print "$n $mid\n";
+	}
+}
-- 
EW


^ permalink raw reply related	[relevance 7%]

Results 1-1 of 1 | reverse | sort options + mbox downloads above
-- links below jump to the message on this page --
2016-07-28 22:01  7% [PATCH] add scripts/xhdr-num2mid example Eric Wong

Code repositories for project(s) associated with this public inbox

	https://80x24.org/public-inbox.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).