From: Derrick Stolee <stolee@gmail.com>
To: Jeff King <peff@peff.net>
Cc: "brian m. carlson" <sandals@crustytoothpaste.net>,
"Jonathan Nieder" <jrnieder@gmail.com>,
"Paul Smith" <paul@mad-scientist.net>,
git@vger.kernel.org, "Duy Nguyen" <pclouds@gmail.com>,
"Ævar Arnfjörð Bjarmason" <avarab@gmail.com>
Subject: Re: [ANNOUNCE] Git v2.19.0-rc0
Date: Fri, 24 Aug 2018 12:45:10 -0400 [thread overview]
Message-ID: <719d5e65-553c-47a1-0b79-41c9af356f3a@gmail.com> (raw)
In-Reply-To: <4b0168ee-4826-1f14-fc83-04c4cec18687@gmail.com>
On 8/23/2018 4:59 PM, Derrick Stolee wrote:
>
> When I choose my own metrics for performance tests, I like to run at
> least 10 runs, remove the largest AND smallest runs from the samples,
> and then take the average. I did this manually for 'git rev-list --all
> --objects' on git/git and got the following results:
>
> v2.18.0 v2.19.0-rc0 HEAD
> --------------------------------
> 3.126 s 3.308 s 3.170 s
>
> For full disclosure, here is a full table including all samples:
>
> | | v2.18.0 | v2.19.0-rc0 | HEAD |
> |------|---------|-------------|---------|
> | | 4.58 | 3.302 | 3.239 |
> | | 3.13 | 3.337 | 3.133 |
> | | 3.213 | 3.291 | 3.159 |
> | | 3.219 | 3.318 | 3.131 |
> | | 3.077 | 3.302 | 3.163 |
> | | 3.074 | 3.328 | 3.119 |
> | | 3.022 | 3.277 | 3.125 |
> | | 3.083 | 3.259 | 3.203 |
> | | 3.057 | 3.311 | 3.223 |
> | | 3.155 | 3.413 | 3.225 |
> | Max | 4.58 | 3.413 | 3.239 |
> | Min | 3.022 | 3.259 | 3.119 |
> | Avg* | 3.126 | 3.30825 | 3.17025 |
>
> (Note that the largest one was the first run, on v2.18.0, which is due
> to a cold disk.)
>
> I just kicked off a script that will run this test on the Linux repo
> while I drive home. I'll be able to report a similar table of data
> easily.
Here are the numbers for Linux:
| | v2.18.0 | v2.19.0-rc0 | HEAD |
|------|----------|-------------|--------|
| | 86.5 | 70.739 | 57.266 |
| | 60.582 | 101.928 | 56.641 |
| | 58.964 | 60.139 | 60.258 |
| | 59.47 | 61.141 | 58.213 |
| | 62.554 | 60.73 | 84.54 |
| | 59.139 | 85.424 | 57.745 |
| | 58.487 | 59.31 | 59.979 |
| | 58.653 | 69.845 | 60.181 |
| | 58.085 | 102.777 | 61.455 |
| | 58.304 | 60.459 | 62.551 |
| Max | 86.5 | 102.777 | 84.54 |
| Min | 58.085 | 59.31 | 56.641 |
| Avg* | 59.51913 | 71.30063 | 59.706 |
| Med | 59.0515 | 65.493 | 60.08 |
Thanks,
-Stolee
next prev parent reply other threads:[~2018-08-24 16:45 UTC|newest]
Thread overview: 58+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-08-20 22:13 [ANNOUNCE] Git v2.19.0-rc0 Junio C Hamano
2018-08-20 22:41 ` Stefan Beller
2018-08-20 23:39 ` Jonathan Nieder
2018-08-21 0:27 ` Jonathan Nieder
2018-08-21 0:46 ` Stefan Beller
2018-08-21 20:41 ` Derrick Stolee
2018-08-21 21:29 ` Jeff King
2018-08-22 0:48 ` brian m. carlson
2018-08-22 3:03 ` Jeff King
2018-08-22 3:36 ` Jeff King
2018-08-22 11:11 ` Derrick Stolee
2018-08-22 5:36 ` brian m. carlson
2018-08-22 6:07 ` Jeff King
2018-08-22 7:39 ` Ævar Arnfjörð Bjarmason
2018-08-22 11:14 ` Derrick Stolee
2018-08-22 15:17 ` Jeff King
2018-08-22 16:08 ` Duy Nguyen
2018-08-22 16:14 ` Duy Nguyen
2018-08-22 16:26 ` Jeff King
2018-08-22 16:49 ` Derrick Stolee
2018-08-22 16:58 ` Duy Nguyen
2018-08-22 17:04 ` Derrick Stolee
2018-08-22 16:59 ` Jeff King
2018-08-22 17:02 ` Junio C Hamano
2018-08-22 15:14 ` Jeff King
2018-08-22 14:28 ` Derrick Stolee
2018-08-22 15:24 ` Jeff King
2018-08-22 12:42 ` Paul Smith
2018-08-22 15:23 ` Jeff King
2018-08-23 1:23 ` Jonathan Nieder
2018-08-23 2:16 ` Jeff King
2018-08-23 2:27 ` Jonathan Nieder
2018-08-23 5:02 ` Jeff King
2018-08-23 5:09 ` brian m. carlson
2018-08-23 5:10 ` Jonathan Nieder
2018-08-23 13:20 ` Junio C Hamano
2018-08-23 16:31 ` wide t/perf output, was " Jeff King
2018-08-23 3:47 ` brian m. carlson
2018-08-23 5:04 ` Jeff King
2018-08-23 10:26 ` Derrick Stolee
2018-08-23 13:16 ` Junio C Hamano
2018-08-23 16:14 ` Jeff King
2018-08-23 23:30 ` Jacob Keller
2018-08-23 23:40 ` Jeff King
2018-08-24 0:06 ` Jeff King
2018-08-24 0:16 ` Jeff King
2018-08-24 2:48 ` Jacob Keller
2018-08-24 2:59 ` Jeff King
2018-08-24 6:45 ` Jeff King
2018-08-24 11:04 ` Derrick Stolee
2018-08-27 19:36 ` Junio C Hamano
2018-08-23 18:53 ` Jeff King
2018-08-23 20:59 ` Derrick Stolee
2018-08-24 6:56 ` Jeff King
2018-08-24 7:57 ` Ævar Arnfjörð Bjarmason
2018-08-24 16:45 ` Derrick Stolee [this message]
2018-08-25 8:26 ` Jeff King
2018-09-02 18:53 ` Kaartic Sivaraam
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: http://vger.kernel.org/majordomo-info.html
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=719d5e65-553c-47a1-0b79-41c9af356f3a@gmail.com \
--to=stolee@gmail.com \
--cc=avarab@gmail.com \
--cc=git@vger.kernel.org \
--cc=jrnieder@gmail.com \
--cc=paul@mad-scientist.net \
--cc=pclouds@gmail.com \
--cc=peff@peff.net \
--cc=sandals@crustytoothpaste.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).