From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS53758 23.128.96.0/24 X-Spam-Status: No, score=-3.9 required=3.0 tests=AWL,BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RCVD_IN_DNSWL_HI, SPF_HELO_PASS,SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by dcvr.yhbt.net (Postfix) with ESMTP id B5C7D1F670 for ; Mon, 25 Oct 2021 16:46:48 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234056AbhJYQtJ (ORCPT ); Mon, 25 Oct 2021 12:49:09 -0400 Received: from cloud.peff.net ([104.130.231.41]:45732 "EHLO cloud.peff.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231127AbhJYQtI (ORCPT ); Mon, 25 Oct 2021 12:49:08 -0400 Received: (qmail 6090 invoked by uid 109); 25 Oct 2021 16:46:45 -0000 Received: from Unknown (HELO peff.net) (10.0.1.2) by cloud.peff.net (qpsmtpd/0.94) with ESMTP; Mon, 25 Oct 2021 16:46:45 +0000 Authentication-Results: cloud.peff.net; auth=none Received: (qmail 20688 invoked by uid 111); 25 Oct 2021 16:46:44 -0000 Received: from coredump.intra.peff.net (HELO sigill.intra.peff.net) (10.0.0.2) by peff.net (qpsmtpd/0.94) with (TLS_AES_256_GCM_SHA384 encrypted) ESMTPS; Mon, 25 Oct 2021 12:46:44 -0400 Authentication-Results: peff.net; auth=none Date: Mon, 25 Oct 2021 12:46:44 -0400 From: Jeff King To: =?utf-8?B?w4Z2YXIgQXJuZmrDtnLDsA==?= Bjarmason Cc: git@vger.kernel.org, Junio C Hamano , Johannes Sixt , =?utf-8?Q?=C3=98ystein?= Walle , Eric Sunshine , Taylor Blau Subject: Re: [PATCH v2 08/10] generate-cmdlist.sh: do not shell out to "sed" Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org On Fri, Oct 22, 2021 at 09:36:12PM +0200, Ævar Arnfjörð Bjarmason wrote: > From: Jeff King > > Replace the "sed" invocation in get_synopsis() with a pure-shell > version. This speeds up generate-cmdlist.sh significantly. Compared to > HEAD~ (old) and "master" we are, according to hyperfine(1): Unsurprisingly I'm in favor of this. ;) Curiously again, I get more dramatic results than you: > 'sh generate-cmdlist.sh command-list.txt' ran > 12.69 ± 5.01 times faster than 'sh generate-cmdlist.sh.old command-list.txt' > 18.34 ± 3.03 times faster than 'sh generate-cmdlist.sh.master command-list.txt' 'sh generate-cmdlist.sh command-list.txt' ran 22.44 ± 13.59 times faster than 'sh generate-cmdlist.sh.old command-list.txt' 57.35 ± 34.10 times faster than 'sh generate-cmdlist.sh.master command-list.txt' It's like spawning processes is somehow faster on your machine than mine. I wonder if it's a CPU governor thing. This is a laptop, and those numbers come from using "powersave". Doing "cpufreq-set -g performance", I get: 'sh generate-cmdlist.sh command-list.txt' ran 14.35 ± 0.23 times faster than 'sh generate-cmdlist.sh.old command-list.txt' 33.15 ± 0.50 times faster than 'sh generate-cmdlist.sh.master command-list.txt' which is closer. But most notably all versions are 3-5x faster than their "powersave" counterparts. I wonder if that has been driving some of the confusion in our timings in this thread. Either way, I think this is still a good direction to go. -Peff