From: "Ævar Arnfjörð Bjarmason" <avarab@gmail.com>
To: git@vger.kernel.org
Cc: "Junio C Hamano" <gitster@pobox.com>, "Jeff King" <peff@peff.net>,
"Felipe Contreras" <felipe.contreras@gmail.com>,
"Adam Spiers" <git@adamspiers.org>,
"Thomas Rast" <tr@thomasrast.ch>,
"Ilya Bobyr" <ilya.bobyr@gmail.com>,
"Patrick Steinhardt" <ps@pks.im>,
"Ævar Arnfjörð Bjarmason" <avarab@gmail.com>
Subject: [PATCH v3 0/9] test-lib tests: split off subtest code in t0000 into lib-subtest.sh
Date: Thu, 5 Aug 2021 12:37:19 +0200 [thread overview]
Message-ID: <cover-v3-0.9-0000000000-20210805T103237Z-avarab@gmail.com> (raw)
In-Reply-To: <cover-0.8-00000000000-20210721T225504Z-avarab@gmail.com>
This series has been looking for reviewer attention for a while. It
splits up the testing of test-lib.sh itself from t0000-basic.sh into a
lib-subtest.sh library, a subsequent series of mine makes use of that
library.
The diffstat is nicely negative since a lot of the test code is
something we could delete as redundant, the tests are also made
stricter as a result (e.g. now checking 1 exit code, not any
non-zero).
For v2, see:
https://lore.kernel.org/git/cover-0.8-00000000000-20210721T225504Z-avarab@gmail.com/
The ony tricky part of this series is the "clever" way of (ab)using
the object store and tags to detect copy/pasted tests. For this v3
I've split that up into its own commit, see [56]/9 for the removal of
the copy/pasting and the assertion, respectively.
This series also depended on ps/t0000-output-directory-fix and
jk/t0000-subtests-fix, since both made it mo "master" it's been
rebased on "master". The range-diff that's not the split-up around
[56]/9 is due to that rebasing.
Ævar Arnfjörð Bjarmason (9):
test-lib tests: move "run_sub_test" to a new lib-subtest.sh
test-lib tests: split up "write and run" into two functions
test-lib tests: stop using a subshell in write_sub_test_lib_test()
test-lib tests: don't provide a description for the sub-tests
test-lib tests: get rid of copy/pasted mock test code
test-lib tests: assert no copy/pasted mock test code
test-lib tests: avoid subshell for "test_cmp" for readability
test-lib tests: refactor common part of check_sub_test_lib_test*()
test-lib tests: assert 1 exit code, not non-zero
t/lib-subtest.sh | 127 ++++++++++++++
t/t0000-basic.sh | 448 +++++++++++++----------------------------------
2 files changed, 245 insertions(+), 330 deletions(-)
create mode 100644 t/lib-subtest.sh
Range-diff against v2:
1: 7a06ea3a7b = 1: 3f34420a3e test-lib tests: move "run_sub_test" to a new lib-subtest.sh
2: 28117b84ab ! 2: c9c16016da test-lib tests: split up "write and run" into two functions
@@ t/lib-subtest.sh: _run_sub_test_lib_test_common () {
run_sub_test_lib_test () {
_run_sub_test_lib_test_common '' "$@"
}
-@@ t/lib-subtest.sh: check_sub_test_lib_test_err () {
- test_cmp expect.err err
- )
- }
-+
## t/t0000-basic.sh ##
@@ t/t0000-basic.sh: test_expect_success 'success is reported like this' '
3: 7d5ed335a3 = 3: 76f57eadcd test-lib tests: stop using a subshell in write_sub_test_lib_test()
4: 2a0dd64da9 = 4: cde015c7dd test-lib tests: don't provide a description for the sub-tests
5: f60190dec6 ! 5: 7d1e6b9a3e test-lib tests: get rid of copy/pasted mock test code
@@ Commit message
run_sub_test_lib_test*() functions let's fix those tests in
t0000-basic.sh that were verbosely copy/pasting earlier tests.
- I'm (ab)using writing a tag object under a ref-name that's
- content-addressable from the content of the test script. If we can
- update-ref that it's unique, if not we've got a duplicate. The tag
- object stores the name of the earlier test for reporting the error.
+ In a subsequent commit we'll add an assertion to check whether we
+ caught all of the copy/pasting.
Signed-off-by: Ævar Arnfjörð Bjarmason <avarab@gmail.com>
- ## t/lib-subtest.sh ##
-@@
-+_assert_unique_sub_test () {
-+ name=$1 &&
-+
-+ # Alert about the copy/paste programming
-+ hash=$(git hash-object -w "$name") &&
-+ cat >tag.sig <<-EOF &&
-+ object $hash
-+ type blob
-+ tag $hash
-+ tagger . <> 0 +0000
-+
-+ duplicate script detected!
-+
-+ This test script was already written as:
-+
-+ $name
-+
-+ You can just re-use its test code with your own
-+ run_sub_test_lib_test*()
-+ EOF
-+
-+ tag=$(git mktag <tag.sig) &&
-+ if ! git update-ref refs/tags/blob-$hash $tag $(test_oid zero) 2>/dev/null
-+ then
-+ msg=$(git for-each-ref refs/tags/blob-$hash \
-+ --format='%(contents)' refs/tags/blob-$hash)
-+ error "on write of $name: $msg"
-+ return 1
-+ fi
-+}
-+
- write_sub_test_lib_test () {
- name="$1" # stdin is the body of the test code
- mkdir "$name" &&
-@@ t/lib-subtest.sh: write_sub_test_lib_test () {
- # Point to the t/test-lib.sh, which isn't in ../ as usual
- . "\$TEST_DIRECTORY"/test-lib.sh
- EOF
-- cat >>"$name/$name.sh"
-+ cat >>"$name/$name.sh" &&
-+ _assert_unique_sub_test "$name/$name.sh"
- }
-
- _run_sub_test_lib_test_common () {
-
## t/t0000-basic.sh ##
@@ t/t0000-basic.sh: test_expect_success 'subtest: --verbose option' '
'
-: ---------- > 6: bc79b29f3c test-lib tests: assert no copy/pasted mock test code
6: 022ddbabf6 ! 7: 48176f3e60 test-lib tests: avoid subshell for "test_cmp" for readability
@@ t/lib-subtest.sh: run_sub_test_lib_test_err () {
+ sed -e 's/^> //' -e 's/Z$//' <&3 >"$name"/expect.err &&
+ test_cmp "$name"/expect.err "$name"/err
}
-
7: ae0226e164 = 8: fda7c4fbe3 test-lib tests: refactor common part of check_sub_test_lib_test*()
8: 676547e001 = 9: dd0af5bd6c test-lib tests: assert 1 exit code, not non-zero
--
2.33.0.rc0.635.g0ab9d6d3b5a
next prev parent reply other threads:[~2021-08-05 10:37 UTC|newest]
Thread overview: 44+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-06-14 10:48 [PATCH 0/8] test-lib tests: split off subtest code in t0000 into lib-subtest.sh Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 1/8] test-lib tests: move "run_sub_test" to a new lib-subtest.sh Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 2/8] test-lib tests: split up "write and run" into two functions Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 3/8] test-lib tests: stop using a subshell in write_sub_test_lib_test() Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 4/8] test-lib tests: don't provide a description for the sub-tests Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 5/8] test-lib tests: get rid of copy/pasted mock test code Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 6/8] test-lib tests: avoid subshell for "test_cmp" for readability Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 7/8] test-lib tests: refactor common part of check_sub_test_lib_test*() Ævar Arnfjörð Bjarmason
2021-06-14 10:48 ` [PATCH 8/8] test-lib tests: assert 1 exit code, not non-zero Ævar Arnfjörð Bjarmason
2021-06-15 2:24 ` [PATCH 0/8] test-lib tests: split off subtest code in t0000 into lib-subtest.sh Junio C Hamano
2021-06-24 10:38 ` Ævar Arnfjörð Bjarmason
2021-06-30 7:04 ` Ævar Arnfjörð Bjarmason
2021-07-01 14:30 ` Junio C Hamano
2021-06-15 18:05 ` Felipe Contreras
2021-07-21 22:57 ` [PATCH v2 " Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 1/8] test-lib tests: move "run_sub_test" to a new lib-subtest.sh Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 2/8] test-lib tests: split up "write and run" into two functions Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 3/8] test-lib tests: stop using a subshell in write_sub_test_lib_test() Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 4/8] test-lib tests: don't provide a description for the sub-tests Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 5/8] test-lib tests: get rid of copy/pasted mock test code Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 6/8] test-lib tests: avoid subshell for "test_cmp" for readability Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 7/8] test-lib tests: refactor common part of check_sub_test_lib_test*() Ævar Arnfjörð Bjarmason
2021-07-21 22:57 ` [PATCH v2 8/8] test-lib tests: assert 1 exit code, not non-zero Ævar Arnfjörð Bjarmason
2021-07-21 23:23 ` [PATCH v2 0/8] test-lib tests: split off subtest code in t0000 into lib-subtest.sh Junio C Hamano
2021-08-05 10:37 ` Ævar Arnfjörð Bjarmason [this message]
2021-08-05 10:37 ` [PATCH v3 1/9] test-lib tests: move "run_sub_test" to a new lib-subtest.sh Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 2/9] test-lib tests: split up "write and run" into two functions Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 3/9] test-lib tests: stop using a subshell in write_sub_test_lib_test() Ævar Arnfjörð Bjarmason
2021-09-22 7:54 ` Carlo Arenas
2021-08-05 10:37 ` [PATCH v3 4/9] test-lib tests: don't provide a description for the sub-tests Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 5/9] test-lib tests: get rid of copy/pasted mock test code Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 6/9] test-lib tests: assert no " Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 7/9] test-lib tests: avoid subshell for "test_cmp" for readability Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 8/9] test-lib tests: refactor common part of check_sub_test_lib_test*() Ævar Arnfjörð Bjarmason
2021-08-05 10:37 ` [PATCH v3 9/9] test-lib tests: assert 1 exit code, not non-zero Ævar Arnfjörð Bjarmason
2021-09-22 8:33 ` [PATCH v3 0/9] test-lib tests: split off subtest code in t0000 into lib-subtest.sh Carlo Arenas
2021-09-22 11:19 ` [PATCH v4 0/7] " Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 1/7] test-lib tests: move "run_sub_test" to a new lib-subtest.sh Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 2/7] test-lib tests: split up "write and run" into two functions Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 3/7] test-lib tests: don't provide a description for the sub-tests Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 4/7] test-lib tests: avoid subshell for "test_cmp" for readability Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 5/7] test-lib tests: refactor common part of check_sub_test_lib_test*() Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 6/7] test-lib tests: assert 1 exit code, not non-zero Ævar Arnfjörð Bjarmason
2021-09-22 11:19 ` [PATCH v4 7/7] test-lib tests: get rid of copy/pasted mock test code Ævar Arnfjörð Bjarmason
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: http://vger.kernel.org/majordomo-info.html
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover-v3-0.9-0000000000-20210805T103237Z-avarab@gmail.com \
--to=avarab@gmail.com \
--cc=felipe.contreras@gmail.com \
--cc=git@adamspiers.org \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=ilya.bobyr@gmail.com \
--cc=peff@peff.net \
--cc=ps@pks.im \
--cc=tr@thomasrast.ch \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).