From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 4F08F1F803 for ; Thu, 10 Jan 2019 21:35:49 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/7] psgi: more memory reductions Date: Thu, 10 Jan 2019 21:35:42 +0000 Message-Id: <20190110213549.19778-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: While of these are as significant as the patch avoid inadvertant MIME objects storage in threads(*), they add up to some meaningful reductions and can make it easier for memory-starved VPS to serve serve public-inboxes. I've diffed output of /T/, /t/ and &x=t endpoints of various HTML pages before and after without finding differences. There's definitely more that can be done in this area, though... Sprinkling Devel::Size::total_size calls in various places (mostly ->getline iterators/callbacks ) was instrumental in the development of these patches. (*) https://public-inbox.org/meta/20190108004606.23760-1-e@80x24.org/ ("view: stop storing all MIME objects on large threads") Eric Wong (7): httpd: remove psgix.harakiri reference searchmsg: get rid of termlist scanning for mid searchmsg: remove Xapian::Document field searchview: drop unused {seen} hashref searchmsg: remove unused fields for PSGI in Xapian results over: cull unneeded fields for get_thread view: more culling for search threads lib/PublicInbox/HTTPD.pm | 1 - lib/PublicInbox/Inbox.pm | 5 ++-- lib/PublicInbox/Over.pm | 19 ++++++++----- lib/PublicInbox/SearchIdx.pm | 6 ++-- lib/PublicInbox/SearchMsg.pm | 49 ++++++++++++++++----------------- lib/PublicInbox/SearchThread.pm | 5 ++++ lib/PublicInbox/SearchView.pm | 1 - lib/PublicInbox/View.pm | 10 +++++-- t/search.t | 10 ++++--- 9 files changed, 60 insertions(+), 46 deletions(-) -- EW