From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 0E0981F4B4 for ; Wed, 3 Feb 2021 08:11:44 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 00/11] lei q --stdin, shortcut names, etc Date: Tue, 2 Feb 2021 22:11:32 -1000 Message-Id: <20210203081143.24424-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: Since externals tend to have common URL or pathname prefixes, it's now possible to use -I/--only/--exclude with just the basename of a URL or directory if that's unambiguous. Wildcard matches are also supported with -I/--only/--exclude. forget-external still requires the full path, but that's rarely-used. add-external bash completion now supports URL hostnames and common base names. "lei q" also supports reading queries from stdin. FD use is slightly reduced, but still far from ideal (it's bad when I have to bump "ulimit -n" to reattach screen(1) while I'm running stress tests). Eric Wong (11): lei: reduce FD pressure from lei2mail worker lei: further reduce lei2mail FD pressure pkt_op: rely on DS::in_loop global lei: err: avoid uninitialized variable warnings lei: propagate curl errors, improve internal consistency lei q: -I/--exclude/--only support globs and basenames lei: complete basenames for include|exclude|only lei: help starts pager lei add-external: completion for existing URL basenames lei: use sleep(1) loop for infinite sleep lei q: support reading queries from stdin MANIFEST | 1 + contrib/completion/lei-completion.bash | 6 ++ lib/PublicInbox/InputPipe.pm | 37 ++++++++++++ lib/PublicInbox/LEI.pm | 37 +++++++----- lib/PublicInbox/LeiExternal.pm | 82 +++++++++++++++++++++----- lib/PublicInbox/LeiOverview.pm | 9 ++- lib/PublicInbox/LeiQuery.pm | 59 ++++++++++++++---- lib/PublicInbox/LeiToMail.pm | 2 +- lib/PublicInbox/LeiXSearch.pm | 20 +++---- lib/PublicInbox/PktOp.pm | 25 +++++--- script/lei | 2 +- t/lei.t | 51 ++++++++++++---- 12 files changed, 248 insertions(+), 83 deletions(-) create mode 100644 lib/PublicInbox/InputPipe.pm