user/dev discussion of public-inbox itself
 help / color / mirror / Atom feed
From: Eric Wong <e@80x24.org>
To: meta@public-inbox.org
Subject: message bloat over time...
Date: Wed, 2 Sep 2020 19:05:25 +0000
Message-ID: <20200902190525.GA11126@dcvr> (raw)

I've been indexing and reindexing a local mirror of
https://lore.kernel.org/lkml a bit, and it's kinda depressing to
see newer messages being more and more bloated even on a
plain-text-only mailing list :<

The first column ("$X.git" is the epoch number, older epochs
are lower-numbered: "0.git" is oldest, "8.git" (not shown) is
the newest.  8.git is omitted since it's still in-progress,
each epoch is capped at roughly ~1.1G of packed git storage.

The last column is the number of messages in that epoch,
so fewer messages fit in each epoch:

  7.git counting 17d7e25e3e862d5d99182557bb723374230a8497 ... 312754
  6.git counting bc9b3c196d0fc92a520e9ad4f92c4d3c1db1943f ... 346017
  5.git counting 31ed379430c456f90bdd172b223020c0e6d7cb8d ... 379561
  4.git counting 88294f6d487193f5984791ee81213a25130d0559 ... 416015
  3.git counting 93d9eace2721494d8457c7f5f6de803c0d648172 ... 453851
  2.git counting d48078ceeec1f51313253a56ed3ba0eae7fde909 ... 455366
  1.git counting 6b67b9f5e0cd82d3c734e6cdc44c1f722ab6fb6a ... 475671
  0.git counting b67bf7f62c8125d67461cc6e7d1736ddc8844a18 ... 570488

So yeah, old epochs could fit more messages because messages
were smaller back then...

/me goes back to yelling at the sky...

             reply	other threads:[~2020-09-02 19:05 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-09-02 19:05 Eric Wong [this message]
2020-09-02 21:38 ` Konstantin Ryabitsev

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://public-inbox.org/README

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20200902190525.GA11126@dcvr \
    --to=e@80x24.org \
    --cc=meta@public-inbox.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

user/dev discussion of public-inbox itself

This inbox may be cloned and mirrored by anyone:

	git clone --mirror https://public-inbox.org/meta
	git clone --mirror http://czquwvybam4bgbro.onion/meta
	git clone --mirror http://hjrcffqmbrq6wope.onion/meta
	git clone --mirror http://ou63pmih66umazou.onion/meta

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V1 meta meta/ https://public-inbox.org/meta \
		meta@public-inbox.org
	public-inbox-index meta

Example config snippet for mirrors.
Newsgroups are available over NNTP:
	nntp://news.public-inbox.org/inbox.comp.mail.public-inbox.meta
	nntp://ou63pmih66umazou.onion/inbox.comp.mail.public-inbox.meta
	nntp://czquwvybam4bgbro.onion/inbox.comp.mail.public-inbox.meta
	nntp://hjrcffqmbrq6wope.onion/inbox.comp.mail.public-inbox.meta
	nntp://news.gmane.io/gmane.mail.public-inbox.general
 note: .onion URLs require Tor: https://www.torproject.org/

code repositories for the project(s) associated with this inbox:

	https://80x24.org/public-inbox.git

AGPL code for this site: git clone https://public-inbox.org/public-inbox.git