about summary refs log tree commit homepage
path: root/lib/PublicInbox/SearchIdx.pm
diff options
authorEric Wong <e@80x24.org>2021-01-03 02:06:16 +0000
committerEric Wong <e@80x24.org>2021-01-03 18:30:32 +0000
commit02ff5cc7ecfe3e36cdd1898c4747c28d83de0e1a (patch)
tree2ca6a9f8f2f7c09f1157362d06d896cf49aeeb3a /lib/PublicInbox/SearchIdx.pm
parent71461c67fee940b05309baa8c67bac10c8c51ac6 (diff)
This fixes a performance regression in multi-process v2 indexing
due to the switch to PublicInbox::IPC.  While Unix sockets are
fewer FDs to manage, pipes allow unprivileged processes to use
larger buffers (up to 1M) on out-of-the-box Linux instances.

A larger buffer via F_SETPIPE_SZ afforded by pipes was proven
valuable during v2 development in 2018 and continues to be
valuable when we get significant amounts of one-way traffic from
the producer parent to worker children.

Compression may be an option for systems without F_SETPIPE_SZ;
but it increases CPU usage with no memory bandwidth savings on
hosts where larger buffers are available.
Diffstat (limited to 'lib/PublicInbox/SearchIdx.pm')
0 files changed, 0 insertions, 0 deletions