From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 354B51F44D for ; Wed, 24 Apr 2024 06:44:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org; s=selector1; t=1713941087; bh=InYT5ueqtHIvmUE4jPWNst1yL+6GBStyAxtQ3sKzO1c=; h=From:To:Subject:Date:From; b=KGv+FemPFreH2qtAbusdUX9EZszJlOSwuqAS9Nj83EbBcUXgEyWed6ZgeQkAL+MH7 2HVrD2AmYRxoHkiYeCKQmfJdRMSTiIwfHzrvT04pe7oVdOOiPkhm+XJWGES7sYsQjS XjfmbemgkMTKdXVjBRPjnClSzRTUFMWI2tLAYPJI= From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/5] www: start using xap_helper process Date: Wed, 24 Apr 2024 06:44:42 +0000 Message-ID: <20240424064447.523799-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: Putting Xapian work into subprocesses will allow us to implement proper timeouts and ultra-expensive queries without harming unrelated queries. It's on by default right now, but I think it's better to keep it off by default to avoid tripping up existing process monitoring tools. Eric Wong (5): searchview: get rid of unused adump callback arg xap_helper.h: remove _SC_NPROCESSORS_ONLN default xap_helper: drop terms+data from `mset' command mbox: hoist out refill_result_ids www: wire up search to use async xap_helper MANIFEST | 2 + lib/PublicInbox/Isearch.pm | 50 +++++++----- lib/PublicInbox/Mbox.pm | 127 ++++++++++++++++------------- lib/PublicInbox/MboxGz.pm | 4 +- lib/PublicInbox/Search.pm | 53 +++++++++++- lib/PublicInbox/SearchView.pm | 58 +++++++------ lib/PublicInbox/XapClient.pm | 1 + lib/PublicInbox/XapHelper.pm | 16 +--- lib/PublicInbox/XhcMset.pm | 51 ++++++++++++ lib/PublicInbox/XhcMsetIterator.pm | 20 +++++ lib/PublicInbox/xap_helper.h | 17 ++-- lib/PublicInbox/xh_mset.h | 57 ++----------- t/cindex.t | 23 +++--- t/xap_helper.t | 29 +++---- 14 files changed, 302 insertions(+), 206 deletions(-) create mode 100644 lib/PublicInbox/XhcMset.pm create mode 100644 lib/PublicInbox/XhcMsetIterator.pm