From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.0 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 6CA2520FD1 for ; Fri, 1 Jul 2016 15:42:25 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 1/2] TODO: update documentation for performance items Date: Fri, 1 Jul 2016 15:42:22 +0000 Message-Id: <20160701154223.3892-2-e@80x24.org> In-Reply-To: <20160701154223.3892-1-e@80x24.org> References: <20160701154223.3892-1-e@80x24.org> List-Id: --- TODO | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/TODO b/TODO index 3b6401f..30ba38b 100644 --- a/TODO +++ b/TODO @@ -1,6 +1,11 @@ TODO items for public-inbox -(Not in any particular order) +(Not in any particular order, and +performance, ease-of-setup, installation, maintainability, etc +all need to be considered for everything we introduce) + +* general performance improvements, but without relying on + XS or compiled code any more than we currently do. * mailmap support (same as git) for remapping expired email addresses @@ -45,6 +50,10 @@ TODO items for public-inbox * Consider storing git blob ID in Xapian doc data to avoid ref and tree lookups based on Message-Id. +* streaming Email::MIME replacement: currently we generate many + allocations/strings for headers we never look at and slurp + entire message bodies into memory. + * Allow in-place Xapian updates without clobbering the whole index (versioning each doc data entry?) for big archives -- EW