user/dev discussion of public-inbox itself
 help / color / Atom feed
* [PATCH] TODO: update with "git cat-file" items
@ 2019-10-01  1:03 Eric Wong
  0 siblings, 0 replies; only message in thread
From: Eric Wong @ 2019-10-01  1:03 UTC (permalink / raw)
  To: meta

Millions of inboxes in an instance is probably not feasible, but
dozens or even hundreds could happen and
/proc/sys/fs/pipe-user-pages-soft is only 16384 on my system,
with each "cat-file --batch" process using 16+1 pages worth
of pipes.
 TODO | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/TODO b/TODO
index 8f78d87d..2c525615 100644
--- a/TODO
+++ b/TODO
@@ -106,3 +106,9 @@ all need to be considered for everything we introduce)
   the latter is missing from OpenBSD and maybe other distros.
 * improve performance and avoid head-of-line blocking on slow storage
+* share "git cat-file --batch" processes across inboxes to avoid
+  bumping into /proc/sys/fs/pipe-user-pages-* limits
+* make "git cat-file --batch" detect unlinked packfiles so we don't
+  have to restart processes (very long-term)

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, back to index

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-10-01  1:03 [PATCH] TODO: update with "git cat-file" items Eric Wong

user/dev discussion of public-inbox itself

Archives are clonable:
	git clone --mirror
	git clone --mirror http://czquwvybam4bgbro.onion/meta
	git clone --mirror http://hjrcffqmbrq6wope.onion/meta
	git clone --mirror http://ou63pmih66umazou.onion/meta

Example config snippet for mirrors

Newsgroups are available over NNTP:

 note: .onion URLs require Tor:

AGPL code for this site: git clone