about summary refs log tree commit homepage
path: root/lib/PublicInbox/IPC.pm
diff options
context:
space:
mode:
authorEric Wong <e@80x24.org>2021-01-18 04:30:31 -0600
committerEric Wong <e@80x24.org>2021-01-18 21:20:25 +0000
commit51191d611e918ff3ef6e9ce8ee52ba7b2cd2144c (patch)
treec787b82356d3f7e42d003a478d8c3a3ce0ee956e /lib/PublicInbox/IPC.pm
parent21671ed82f8d1a7b6de593e073079e29c5675aa8 (diff)
downloadpublic-inbox-51191d611e918ff3ef6e9ce8ee52ba7b2cd2144c.tar.gz
With 4 dedicated workers, this seems to provide a 100-120%
speedup on a 4 core machine when writing thousands of search
results to a Maildir or mbox.  This also sets us up for
high-latency IMAP destinations in the future.

This opens the door to more speedup opportunities such
as optimizing dedupe locking and other ways to reduce
contention.

This change is fairly complex and convoluted, unfortunately.
Further work may allow us to simplify it and even improve
performance.
Diffstat (limited to 'lib/PublicInbox/IPC.pm')
-rw-r--r--lib/PublicInbox/IPC.pm3
1 files changed, 3 insertions, 0 deletions
diff --git a/lib/PublicInbox/IPC.pm b/lib/PublicInbox/IPC.pm
index 78cb8400..8fec2e62 100644
--- a/lib/PublicInbox/IPC.pm
+++ b/lib/PublicInbox/IPC.pm
@@ -397,4 +397,7 @@ sub DESTROY {
         ipc_worker_stop($self);
 }
 
+# Sereal doesn't have dclone
+sub deep_clone { thaw(freeze($_[-1])) }
+
 1;