[PUSHED 0/2] relnotes and some notes about the future

[PUSHED 0/2] relnotes and some notes about the future

[Eric Wong]

So I've got some vague ideas of what 1.5 will entail...

I'm still disatisfied with memory consumption and performance;
so more on that.  Maybe some more optional Inline::C, but
ease-of-installation still must be taken into account.

I started writing Documentation/technical/data_structures.txt a
some time ago and realized we could reduce, eliminate and reuse
some data structures.  That would allow us to document less
things, reduce cognitive load on hackers, AND save some RAM :>

Another place that bothers me is we build up big, per-message
memory buffers for HTML/Atom feeds.  Since most HTTP requests
are compressed anyways, I've been slowing moving towards
buffering directly to gzip, allowing our internal memory
representation to be compressed.  Though it may not help a lot
because deflate contexts take several dozen kilobytes of RAM.
Still, that allows us to avoid Plack::Middleware::Deflater and
the memory-wasting closures it imposes.  And one less
dependency in the INSTALL file, too.

Eric Wong (2):
  public-inbox 1.4.0
  doc: update 1.4.0 relnotes with date, start 1.5.0

 Documentation/RelNotes/v1.4.0.eml | 29 ++++++++++++++++++++++-------
 Documentation/RelNotes/v1.5.0.eml | 13 +++++++++++++
 MANIFEST                          |  1 +
 Makefile.PL                       |  4 ++--
 4 files changed, 38 insertions(+), 9 deletions(-)
 create mode 100644 Documentation/RelNotes/v1.5.0.eml

[PATCH 1/2] public-inbox 1.4.0

[Eric Wong]

---
 Documentation/RelNotes/v1.4.0.eml | 27 ++++++++++++++++++++-------
 Makefile.PL                       |  4 ++--
 2 files changed, 22 insertions(+), 9 deletions(-)

diff --git a/Documentation/RelNotes/v1.4.0.eml b/Documentation/RelNotes/v1.4.0.eml
index b8f6c9b0..ae7c1457 100644
--- a/Documentation/RelNotes/v1.4.0.eml
+++ b/Documentation/RelNotes/v1.4.0.eml
@@ -1,6 +1,7 @@
 From: Eric Wong <e@yhbt.net>
 To: meta@public-inbox.org
-Subject: [WIP] public-inbox 1.4.0
+Subject: [ANNOUNCE] public-inbox 1.4.0
+Message-Id: <20200417084800.public-inbox-1.4.0-rele@sed>
 MIME-Version: 1.0
 Content-Type: text/plain; charset=utf-8
 
@@ -8,10 +9,10 @@ This release focuses on reproducibility improvements and
 bugfixes for corner-cases.  Busy instances of PublicInbox::WWW
 may also notice memory usage reductions.
 
-Rare messages lacking Date and/or Received headers, mirrors now
-fallback to using the git author/commit times to reindex those
-messages to ensure search and filtering queries behave the same
-in mirrors as they do on the original machine.
+For rare messages lacking Date and/or Received headers, mirrors
+now fall back to using the git author/commit times to reindex
+them.  This ensures search and filtering queries behave
+identically on mirrors as they do on the original machine.
 
 "altid" SQLite dumps are now accessible to all over the WWW
 interface via `POST /$INBOX/$ALTID.sql.gz'.
@@ -39,7 +40,7 @@ memory fragmentation in daemons.
 
 * PublicInbox::WWW:
 
-  - reduced memory use for single message "permalink" view
+  - memory reductions for message display and rendering
   - code preload improved to reduce memory fragmentation
   - remove redundant "a=" parameter in links to solver
   - escape '&' in hrefs properly
@@ -65,7 +66,19 @@ memory fragmentation in daemons.
 
 * documentation:
 
-  - Documentation/technical/data_structures.txt add for new hackers.
+  - add Documentation/technical/data_structures.txt for new hackers
+
+* scripts/import_vger_from_mbox: (not really a production-level script)
+
+  - fix ">From" unescaping thanks to a bug report from Kyle Meyer
+
+Thanks to Andreas Rottmann, Leah Neukirchen and Kyle Meyer
+for their contributions to this release.
+
+Release tarball available for download over HTTPS or Tor .onion:
+
+https://yhbt.net/public-inbox.git/snapshot/public-inbox-1.4.0.tar.gz
+http://ou63pmih66umazou.onion/public-inbox.git/snapshot/public-inbox-1.4.0.tar.gz
 
 Please report bugs via plain-text mail to: meta@public-inbox.org
 
diff --git a/Makefile.PL b/Makefile.PL
index 566ce3bc..ab24b9cf 100644
--- a/Makefile.PL
+++ b/Makefile.PL
@@ -8,7 +8,7 @@ chomp(my @manifest = (<$m>));
 my @EXE_FILES = grep(m!^script/!, @manifest);
 my $v = {};
 my $t = {};
-my @RELEASES = qw(v1.3.0 v1.2.0 v1.1.0-pre1 v1.0.0); # do not sort
+my @RELEASES = qw(v1.4.0 v1.3.0 v1.2.0 v1.1.0-pre1 v1.0.0); # do not sort
 $v->{news_deps} = [ map { "Documentation/RelNotes/$_.eml" } @RELEASES ];
 $v->{txt} = [ qw(INSTALL README COPYING TODO HACKING) ];
 my @dtxt = grep(m!\ADocumentation/[^/]+\.txt\z!, @manifest);
@@ -109,7 +109,7 @@ my %man3 = map {; # semi-colon tells Perl this is a BLOCK (and not EXPR)
 
 WriteMakefile(
 	NAME => 'PublicInbox',
-	VERSION => '1.3.0',
+	VERSION => '1.4.0',
 	AUTHOR => 'Eric Wong <e@yhbt.net>',
 	ABSTRACT => 'public-inbox server infrastructure',
 	EXE_FILES => \@EXE_FILES,

[PATCH 2/2] doc: update 1.4.0 relnotes with date, start 1.5.0

[Eric Wong]

---
 Documentation/RelNotes/v1.4.0.eml |  4 +++-
 Documentation/RelNotes/v1.5.0.eml | 13 +++++++++++++
 MANIFEST                          |  1 +
 3 files changed, 17 insertions(+), 1 deletion(-)
 create mode 100644 Documentation/RelNotes/v1.5.0.eml

diff --git a/Documentation/RelNotes/v1.4.0.eml b/Documentation/RelNotes/v1.4.0.eml
index ae7c1457..845895b5 100644
--- a/Documentation/RelNotes/v1.4.0.eml
+++ b/Documentation/RelNotes/v1.4.0.eml
@@ -1,9 +1,11 @@
+Date: Fri, 17 Apr 2020 08:48:59 +0000
 From: Eric Wong <e@yhbt.net>
 To: meta@public-inbox.org
 Subject: [ANNOUNCE] public-inbox 1.4.0
-Message-Id: <20200417084800.public-inbox-1.4.0-rele@sed>
+Message-ID: <20200417084800.public-inbox-1.4.0-rele@sed>
 MIME-Version: 1.0
 Content-Type: text/plain; charset=utf-8
+Content-Disposition: inline
 
 This release focuses on reproducibility improvements and
 bugfixes for corner-cases.  Busy instances of PublicInbox::WWW
diff --git a/Documentation/RelNotes/v1.5.0.eml b/Documentation/RelNotes/v1.5.0.eml
new file mode 100644
index 00000000..4b01eef2
--- /dev/null
+++ b/Documentation/RelNotes/v1.5.0.eml
@@ -0,0 +1,13 @@
+From: Eric Wong <e@yhbt.net>
+To: meta@public-inbox.org
+Subject: [WIP] public-inbox 1.5.0
+MIME-Version: 1.0
+Content-Type: text/plain; charset=utf-8
+Content-Disposition: inline
+
+TBD
+
+Please report bugs via plain-text mail to: meta@public-inbox.org
+
+See archives at https://public-inbox.org/meta/ for all history.
+See https://public-inbox.org/TODO for what the future holds.
diff --git a/MANIFEST b/MANIFEST
index cb7d52a7..ba5cc6a4 100644
--- a/MANIFEST
+++ b/MANIFEST
@@ -8,6 +8,7 @@ Documentation/RelNotes/v1.1.0-pre1.eml
 Documentation/RelNotes/v1.2.0.eml
 Documentation/RelNotes/v1.3.0.eml
 Documentation/RelNotes/v1.4.0.eml
+Documentation/RelNotes/v1.5.0.eml
 Documentation/dc-dlvr-spam-flow.txt
 Documentation/design_notes.txt
 Documentation/design_www.txt