user/dev discussion of public-inbox itself
 help / color / mirror / code / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download mbox.gz: |
* [PATCH 2/3] doc/cindex: point no-fsync,dangerous to -index(1)
  2023-11-21 12:43  5% [PATCH 0/3] cindex: rename `associate' to `join' Eric Wong
@ 2023-11-21 12:43  7% ` Eric Wong
  0 siblings, 0 replies; 2+ results
From: Eric Wong @ 2023-11-21 12:43 UTC (permalink / raw)
  To: meta

There's no point in duplicating --no-fsync documentation across
manpages.  --dangerous can be useful for reducing SSD wear, so
add a pointer to it as well.
---
 Documentation/public-inbox-cindex.pod | 7 +------
 1 file changed, 1 insertion(+), 6 deletions(-)

diff --git a/Documentation/public-inbox-cindex.pod b/Documentation/public-inbox-cindex.pod
index d2d5dadc..3ff394be 100644
--- a/Documentation/public-inbox-cindex.pod
+++ b/Documentation/public-inbox-cindex.pod
@@ -64,12 +64,7 @@ Use this after L<git-gc(1)> (or L<git-prune(1)>).
 
 =item --no-fsync
 
-Disables L<fsync(2)> and L<fdatasync(2)> operations on SQLite
-and Xapian.  This is only effective with Xapian 1.4+.  This is
-primarily intended for systems with low RAM and the small
-(default) C<--batch-size=1m>.  Users of large C<--batch-size>
-may even find disabling L<fdatasync(2)> causes too much dirty
-data to accumulate, resulting on latency spikes from writeback.
+=item --dangerous
 
 =item --max-size SIZE
 

^ permalink raw reply related	[relevance 7%]

* [PATCH 0/3] cindex: rename `associate' to `join'
@ 2023-11-21 12:43  5% Eric Wong
  2023-11-21 12:43  7% ` [PATCH 2/3] doc/cindex: point no-fsync,dangerous to -index(1) Eric Wong
  0 siblings, 1 reply; 2+ results
From: Eric Wong @ 2023-11-21 12:43 UTC (permalink / raw)
  To: meta

3/3 fleshes out more join functionality, including storing the
join data in compressed JSON as Xapian metadata and loading it
as a Perl hash won't be excessive (compared to having 30-50k
inbox names+paths in memory).

Eric Wong (3):
  cindex: avoid unneeded and redundant `local' calls
  doc/cindex: point no-fsync+dangerous to -index(1)
  cindex: rename --associate to --join, test w/ real repos

 Documentation/public-inbox-cindex.pod |   7 +-
 MANIFEST                              |   1 +
 lib/PublicInbox/CodeSearch.pm         |  62 ++++-
 lib/PublicInbox/CodeSearchIdx.pm      | 383 ++++++++++++++++----------
 lib/PublicInbox/TestCommon.pm         |   9 +-
 lib/PublicInbox/XapHelper.pm          |  14 +-
 lib/PublicInbox/xap_helper.h          |  59 ++--
 script/public-inbox-cindex            |   8 +-
 t/cindex-join.t                       |  83 ++++++
 t/cindex.t                            |   8 +-
 10 files changed, 428 insertions(+), 206 deletions(-)
 create mode 100644 t/cindex-join.t

^ permalink raw reply	[relevance 5%]

Results 1-2 of 2 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2023-11-21 12:43  5% [PATCH 0/3] cindex: rename `associate' to `join' Eric Wong
2023-11-21 12:43  7% ` [PATCH 2/3] doc/cindex: point no-fsync,dangerous to -index(1) Eric Wong

Code repositories for project(s) associated with this public inbox

	https://80x24.org/public-inbox.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).