user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
* [PATCH] TODO: update with "git cat-file" items
@ 2019-10-01  1:03 Eric Wong
  0 siblings, 0 replies; only message in thread
From: Eric Wong @ 2019-10-01  1:03 UTC (permalink / raw)
  To: meta

Millions of inboxes in an instance is probably not feasible, but
dozens or even hundreds could happen and
/proc/sys/fs/pipe-user-pages-soft is only 16384 on my system,
with each "cat-file --batch" process using 16+1 pages worth
of pipes.
 TODO | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/TODO b/TODO
index 8f78d87d..2c525615 100644
--- a/TODO
+++ b/TODO
@@ -106,3 +106,9 @@ all need to be considered for everything we introduce)
   the latter is missing from OpenBSD and maybe other distros.
 * improve performance and avoid head-of-line blocking on slow storage
+* share "git cat-file --batch" processes across inboxes to avoid
+  bumping into /proc/sys/fs/pipe-user-pages-* limits
+* make "git cat-file --batch" detect unlinked packfiles so we don't
+  have to restart processes (very long-term)

^ permalink raw reply related	[flat|nested] only message in thread

only message in thread, other threads:[~2019-10-01  1:03 UTC | newest]

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-10-01  1:03 [PATCH] TODO: update with "git cat-file" items Eric Wong

Code repositories for project(s) associated with this public inbox

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).