diff options
author | Eric Wong <e@80x24.org> | 2023-11-07 13:01:47 +0000 |
---|---|---|
committer | Eric Wong <e@80x24.org> | 2023-11-07 13:23:36 +0000 |
commit | e97a30e7624dfb8645aa33a94844bcf28c7e1379 (patch) | |
tree | 9f28b7273c795b0e0579d42728fdfad1e5dbfeac /lib/PublicInbox/LeiToMail.pm | |
parent | c1f27d21213f05bd4656e24ec5a5a076ebaa6afd (diff) | |
download | public-inbox-e97a30e7624dfb8645aa33a94844bcf28c7e1379.tar.gz |
When dealing with large search results, we need to deal with EPIPE not just from the pager, but also EPIPE or ECONNRESET between lei_xsearch and lei2mail processes. Without this fix, lei_xsearch processes could linger and get stuck writing to dead lei2mail processes if a user aborts the pager early during a large result set. To ensure lei_xsearch processes don't linger around after lei2mail workers all die, we must close $l2m->{-wq_s2} before spawning lei_xsearch processes, since $l2m->{-wq_s2} is only used in lei2mail workers. For `git cat-file' processes, we also need to trigger PublicInbox::Git->close to handle unpredictable destructor ordering to avoid using uninitialized IO refs. This combines with the `git_to_mail' change to deal with process cleanup handling from premature shutdowns. To test all this, we can't just rely on a single message being large, but also need to rely on the result set being large enough to saturate the lei_xsearch -> lei2mail socket so we rely on GIANT_INBOX_DIR once again.
Diffstat (limited to 'lib/PublicInbox/LeiToMail.pm')
-rw-r--r-- | lib/PublicInbox/LeiToMail.pm | 8 |
1 files changed, 7 insertions, 1 deletions
diff --git a/lib/PublicInbox/LeiToMail.pm b/lib/PublicInbox/LeiToMail.pm index e80163e2..b73af68a 100644 --- a/lib/PublicInbox/LeiToMail.pm +++ b/lib/PublicInbox/LeiToMail.pm @@ -8,11 +8,13 @@ use v5.10.1; use parent qw(PublicInbox::IPC); use PublicInbox::Eml; use PublicInbox::IO; +use PublicInbox::Git; use PublicInbox::Spawn qw(spawn); use IO::Handle; # ->autoflush use Fcntl qw(SEEK_SET SEEK_END O_CREAT O_EXCL O_WRONLY); use PublicInbox::Syscall qw(rename_noreplace); use autodie qw(open seek close); +use Carp qw(croak); my %kw2char = ( # Maildir characters draft => 'D', @@ -132,8 +134,12 @@ sub eml2mboxcl2 { sub git_to_mail { # git->cat_async callback my ($bref, $oid, $type, $size, $smsg) = @_; - my $self = delete $smsg->{l2m} // die "BUG: no l2m"; $type // return; # called by PublicInbox::Git::close + my $self = delete $smsg->{l2m}; + if (!defined($self)) { + return if $PublicInbox::Git::in_cleanup; + croak "BUG: no l2m (type=$type)"; + } eval { if ($type eq 'missing' && ($bref = $self->{-lms_rw}->local_blob($oid, 1))) { |