user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download mbox.gz: |
* [PATCH 7/7] index: filter out indexlevel=basic from extindex
  2020-12-25 10:21  6% [PATCH 0/7] index + extindex interaction improvements Eric Wong
@ 2020-12-25 10:21  7% ` Eric Wong
  0 siblings, 0 replies; 2+ results
From: Eric Wong @ 2020-12-25 10:21 UTC (permalink / raw)
  To: meta

extindex users will likely want to use indexlevel=basic for
per-inbox indices, however extindex itself doesn't support basic
index level (yet?).  Let's ensure we don't trip up extindex
users who specify "-L basic" on the -index command-line.
---
 script/public-inbox-index | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/script/public-inbox-index b/script/public-inbox-index
index c68f9224..0fdfddc0 100755
--- a/script/public-inbox-index
+++ b/script/public-inbox-index
@@ -84,8 +84,10 @@ for my $ei_name (@$update_extindex) {
 	} else {
 		die "extindex `$ei_name' not configured or found\n";
 	}
+	my $o = { %$opt };
+	delete $o->{indexlevel} if ($o->{indexlevel}//'') eq 'basic';
 	$eidx_seen{$topdir} //=
-		push(@eidx, PublicInbox::ExtSearchIdx->new($topdir, $opt));
+		push(@eidx, PublicInbox::ExtSearchIdx->new($topdir, $o));
 }
 my $mods = {};
 my @eidx_unconfigured;

^ permalink raw reply related	[relevance 7%]

* [PATCH 0/7] index + extindex interaction improvements
@ 2020-12-25 10:21  6% Eric Wong
  2020-12-25 10:21  7% ` [PATCH 7/7] index: filter out indexlevel=basic from extindex Eric Wong
  0 siblings, 1 reply; 2+ results
From: Eric Wong @ 2020-12-25 10:21 UTC (permalink / raw)
  To: meta

Some things which make -index less painful when auto-updating
external indices.

"public-inbox-extindex --all" itself is still painfully slow
with 50K inboxes, but I think that can only be used once for
initialization and -index can be relied on for all incremental
updates.


Eric Wong (7):
  index: disable --fast-noop on --reindex
  extsearchidx: delay SQLite availability checks
  extsearchidx: close DB handles after use if FD constrained
  index: do not attach inbox to extindex unless updated
  index: fix --no-fsync flag propagation to extindex
  v2writable: don't verify tip if reindexing
  index: filter out indexlevel=basic from extindex

 lib/PublicInbox/Admin.pm        |  1 +
 lib/PublicInbox/ExtSearchIdx.pm | 96 +++++++++++++++++++++------------
 lib/PublicInbox/SearchIdx.pm    |  2 +
 lib/PublicInbox/V2Writable.pm   | 36 +++++++++----
 script/public-inbox-index       | 27 ++++++----
 5 files changed, 109 insertions(+), 53 deletions(-)


^ permalink raw reply	[relevance 6%]

Results 1-2 of 2 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2020-12-25 10:21  6% [PATCH 0/7] index + extindex interaction improvements Eric Wong
2020-12-25 10:21  7% ` [PATCH 7/7] index: filter out indexlevel=basic from extindex Eric Wong

Code repositories for project(s) associated with this public inbox

	https://80x24.org/public-inbox.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).