user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download mbox.gz: |
* [PATCH 16/28] sigfd: pass signal name rather than number to callback
  @ 2023-03-21 23:07  7%   ` Eric Wong
  0 siblings, 0 replies; 2+ results
From: Eric Wong @ 2023-03-21 23:07 UTC (permalink / raw)
  To: meta

This is consistent with normal Perl %SIG handlers, and allows
-cindex signal handlers to be implemented consistently across
platforms.
---
 lib/PublicInbox/CodeSearchIdx.pm |  2 +-
 lib/PublicInbox/Daemon.pm        |  2 +-
 lib/PublicInbox/Sigfd.pm         | 10 +++++-----
 3 files changed, 7 insertions(+), 7 deletions(-)

diff --git a/lib/PublicInbox/CodeSearchIdx.pm b/lib/PublicInbox/CodeSearchIdx.pm
index 82f90368..fcd28671 100644
--- a/lib/PublicInbox/CodeSearchIdx.pm
+++ b/lib/PublicInbox/CodeSearchIdx.pm
@@ -546,7 +546,7 @@ sub shards_active { # post_loop_do
 sub kill_shards { $_->wq_kill(@_) for @IDX_SHARDS }
 
 sub parent_quit {
-	$DO_QUIT = $_[0];
+	$DO_QUIT = POSIX->can("SIG$_[0]")->();
 	kill_shards(@_);
 	warn "# SIG$_[0] received, quitting...\n";
 }
diff --git a/lib/PublicInbox/Daemon.pm b/lib/PublicInbox/Daemon.pm
index 6152a5d3..57435421 100644
--- a/lib/PublicInbox/Daemon.pm
+++ b/lib/PublicInbox/Daemon.pm
@@ -510,7 +510,7 @@ sub upgrade_aborted ($) {
 	warn $@, "\n" if $@;
 }
 
-sub reap_children { # $_[0] = 'CHLD' or POSIX::SIGCHLD()
+sub reap_children { # $_[0] = 'CHLD'
 	while (1) {
 		my $p = waitpid(-1, WNOHANG) or return;
 		if (defined $reexec_pid && $p == $reexec_pid) {
diff --git a/lib/PublicInbox/Sigfd.pm b/lib/PublicInbox/Sigfd.pm
index 3d964be3..3c1d3811 100644
--- a/lib/PublicInbox/Sigfd.pm
+++ b/lib/PublicInbox/Sigfd.pm
@@ -4,7 +4,7 @@
 # Wraps a signalfd (or similar) for PublicInbox::DS
 # fields: (sig: hashref similar to %SIG, but signal numbers as keys)
 package PublicInbox::Sigfd;
-use strict;
+use v5.12;
 use parent qw(PublicInbox::DS);
 use PublicInbox::Syscall qw(signalfd EPOLLIN EPOLLET %SIGNUM);
 use POSIX ();
@@ -14,8 +14,8 @@ use POSIX ();
 sub new {
 	my ($class, $sig, $nonblock) = @_;
 	my %signo = map {;
-		# $num => $cb;
-		($SIGNUM{$_} // POSIX->can("SIG$_")->()) => $sig->{$_}
+		# $num => [ $cb, $signame ];
+		($SIGNUM{$_} // POSIX->can("SIG$_")->()) => [ $sig->{$_}, $_ ]
 	} keys %$sig;
 	my $self = bless { sig => \%signo }, $class;
 	my $io;
@@ -45,8 +45,8 @@ sub wait_once ($) {
 		for my $off (0..$nr) {
 			# the first uint32_t of signalfd_siginfo: ssi_signo
 			my $signo = unpack('L', substr($buf, 128 * $off, 4));
-			my $cb = $self->{sig}->{$signo};
-			$cb->($signo) if $cb ne 'IGNORE';
+			my ($cb, $signame) = @{$self->{sig}->{$signo}};
+			$cb->($signame) if $cb ne 'IGNORE';
 		}
 	}
 	$r;

^ permalink raw reply related	[relevance 7%]

* [PATCH 00/28] cindex coderepo commit indexer
@ 2023-03-21 23:07  4% Eric Wong
    0 siblings, 1 reply; 2+ results
From: Eric Wong @ 2023-03-21 23:07 UTC (permalink / raw)
  To: meta

Not wired up to WWW nor lei, yet; but indexing + pruning of
commits works.

I'm not sure if indexing (root) tree OIDs or committer
names+emails is worth it, since I don't think those are very
important terms to search for.

I first wanted to shoehorn this into extindex, but I think it
works better as a separate Xapian schema.

It allows both internal indexes ($GIT_DIR/public-inbox-cindex)
for unforked repos, as well as extindex-style external index
to encompass several projects.

The indexer is structured a bit more nicely than existing
indexers since I'm relying on OnDestroy and `local', more.
I would like to trickle some of these improvements back to
the mail indexers at some point.

--prune and --reindex currently block incremental updates, which
isn't great since both take a while for giant Xapian DBs.

Pruning is pretty important since it's much common for coderepos
(e.g. `seen' branch of git.git)

`lei cq' will probably be a new command which behaves
similarly to `lei q -f text', but takes `git log' options
for output...

Eric Wong (28):
  ipc: move nproc_shards from v2writable
  search: relocate all_terms from lei_search
  admin: hoist out resolve_git_dir
  admin: ensure resolved GIT_DIR is absolute
  test_common: create_inbox: use `$!' properly on mkdir failure
  codesearch: initial cut w/ -cindex tool
  cindex: parallelize prep phases
  cindex: use read-only shards during prep phases
  searchidxshard: improve comment wording
  cindex: use DS and workqueues for parallelism
  ds: @post_loop_do replaces SetPostLoopCallback
  cindex: implement --exclude= like -clone
  cindex: show shard number in progress message
  cindex: drop `unchanged' progress message
  cindex: handle graceful shutdown by default
  sigfd: pass signal name rather than number to callback
  cindex: implement --max-size=SIZE
  cindex: check for checkpoint before giant messages
  cindex: truncate or drop body for over-sized commits
  cindex: attempt to give oldest commits lowest docids
  cindex: improve granularity of quit checks
  spawn: show failing directory for chdir failures
  cindex: filter out non-existent git directories
  cindex: add support for --prune
  cindex: implement reindex
  cindex: squelch incompatible options
  cindex: respect existing permissions
  cindex: ignore SIGPIPE

 MANIFEST                          |   4 +
 lib/PublicInbox/Admin.pm          |  18 +-
 lib/PublicInbox/CodeSearch.pm     | 121 +++++
 lib/PublicInbox/CodeSearchIdx.pm  | 835 ++++++++++++++++++++++++++++++
 lib/PublicInbox/Config.pm         |   2 +-
 lib/PublicInbox/DS.pm             |  30 +-
 lib/PublicInbox/Daemon.pm         |   4 +-
 lib/PublicInbox/ExtSearchIdx.pm   |   2 +-
 lib/PublicInbox/IPC.pm            |  33 +-
 lib/PublicInbox/LEI.pm            |   4 +-
 lib/PublicInbox/LeiSearch.pm      |  14 -
 lib/PublicInbox/MiscIdx.pm        |   2 +-
 lib/PublicInbox/Search.pm         |  77 ++-
 lib/PublicInbox/SearchIdx.pm      |  88 ++--
 lib/PublicInbox/SearchIdxShard.pm |   7 +-
 lib/PublicInbox/Sigfd.pm          |  10 +-
 lib/PublicInbox/Spawn.pm          |   6 +-
 lib/PublicInbox/SpawnPP.pm        |   2 +-
 lib/PublicInbox/TestCommon.pm     |  47 +-
 lib/PublicInbox/V2Writable.pm     |  26 +-
 lib/PublicInbox/Watch.pm          |   2 +-
 script/public-inbox-cindex        |  86 +++
 script/public-inbox-convert       |   2 +-
 t/cindex.t                        | 134 +++++
 t/dir_idle.t                      |   6 +-
 t/ds-leak.t                       |   8 +-
 t/imapd.t                         |   6 +-
 t/nntpd.t                         |   2 +-
 t/sigfd.t                         |   7 +-
 t/watch_maildir.t                 |   8 +-
 xt/mem-imapd-tls.t                |   7 +-
 xt/mem-nntpd-tls.t                |   8 +-
 xt/net_writer-imap.t              |   4 +-
 33 files changed, 1424 insertions(+), 188 deletions(-)
 create mode 100644 lib/PublicInbox/CodeSearch.pm
 create mode 100644 lib/PublicInbox/CodeSearchIdx.pm
 create mode 100755 script/public-inbox-cindex
 create mode 100644 t/cindex.t

^ permalink raw reply	[relevance 4%]

Results 1-2 of 2 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2023-03-21 23:07  4% [PATCH 00/28] cindex coderepo commit indexer Eric Wong
2023-03-21 23:07     ` [PATCH 01/28] ipc: move nproc_shards from v2writable Eric Wong
2023-03-21 23:07  7%   ` [PATCH 16/28] sigfd: pass signal name rather than number to callback Eric Wong

Code repositories for project(s) associated with this public inbox

	https://80x24.org/public-inbox.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).