From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-3.8 required=3.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from out1.vger.email (out1.vger.email [IPv6:2620:137:e000::1:20]) by dcvr.yhbt.net (Postfix) with ESMTP id C327A1F428 for ; Mon, 20 Mar 2023 20:03:33 +0000 (UTC) Authentication-Results: dcvr.yhbt.net; dkim=pass (2048-bit key; secure) header.d=web.de header.i=l.s.r@web.de header.a=rsa-sha256 header.s=s29768273 header.b=SH2EegMa; dkim-atps=neutral Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231220AbjCTUDc (ORCPT ); Mon, 20 Mar 2023 16:03:32 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39812 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230356AbjCTUDY (ORCPT ); Mon, 20 Mar 2023 16:03:24 -0400 Received: from mout.web.de (mout.web.de [212.227.15.3]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id DC5E7270B for ; Mon, 20 Mar 2023 13:03:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=web.de; s=s29768273; t=1679342574; i=l.s.r@web.de; bh=CZPQIyBdJyQRb3ZhmJW7uqAjv66My0vDEtkiny0OnZ0=; h=X-UI-Sender-Class:Date:Subject:From:To:Cc:References:In-Reply-To; b=SH2EegMahohn4kZAssBOi9r4xiUIF60hXWa/lw0wWrcGzj7sun7Jv/lL6cwEnpxP/ V/Mxt5xtSe289Nl3CbuyEH8MvpwN8CM1MCUOWPJln8ZC0ASyG5xfC5PDTP7jVXGJS1 CEjzEwcytY/eWQRpGVDtQ2LHAkkDxy5wZRd6cNN01uiGyWE/cAbnuDXmUWNh0tuvMl yhUBXUrVEwLEgdWh4digFYpGcPwltDuD6tCezGgIyPNyQ6B2wRW7eEG1F4+ahOIubT gb21SEspW3cfTS+rrGE/w2v6+Tg6We5usYYfNseQV0cq0fmUQsPslDhVAsQpLOV0FC IUNbijzJANxmw== X-UI-Sender-Class: 814a7b36-bfc1-4dae-8640-3722d8ec6cd6 Received: from [192.168.178.29] ([79.203.31.43]) by smtp.web.de (mrweb005 [213.165.67.108]) with ESMTPSA (Nemesis) id 1MF2gW-1pgUNC0FOi-00Fmzg; Mon, 20 Mar 2023 21:02:54 +0100 Message-ID: Date: Mon, 20 Mar 2023 21:02:53 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Subject: [PATCH] archive: improve support for running in a subdirectory From: =?UTF-8?Q?Ren=c3=a9_Scharfe?= To: git@vger.kernel.org Cc: Cristian Le , =?UTF-8?Q?Matthias_G=c3=b6rgens?= , Junio C Hamano References: <42f13cda-9de6-bfc6-7e81-64c94f5640db@mpsd.mpg.de> <8d04019d-511f-0f99-42cc-d0b25720cd71@mpsd.mpg.de> <70f10864-2cc7-cb9e-f868-2ac0011cad58@web.de> <3da35216-ca42-9759-d4f9-20451a44c231@web.de> <9e215e5c-0b67-0362-fd53-8c22b8d348ff@web.de> Content-Language: en-US In-Reply-To: <9e215e5c-0b67-0362-fd53-8c22b8d348ff@web.de> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:HPkUMgOLGt3ArKMEy1Q0nkiRcYv8wBHeqDhKKBneU8SEttOwUcA eA4iBi+LXeYZZkSoIociyAEyC96T79NKkq0uqQxSdEETRkO8sZ/QudJDs4fx6/pNZHkuo3i iSC7/eVqXrltUOhOyDW8qdzOLkaApbtctAsfhjca+0GwBYOILqvntdpaByTRMgxz1OfTe8S j91n5tqDT1467dIKOmlxw== UI-OutboundReport: notjunk:1;M01:P0:SKNMygovCpU=;sx1ZfzcNaoN/HGO4L9TqlHD3DpE Vcuzj2198yk5SJfC6te58zFuUayw1aO3Dr1R+m66fa+ygyUICYway8/PGirs/f8BTCqbuq8PW UQqvxajciCWU95VKSf+ugG0PRJq/ixqUUa1oPENkAce+FV2OADBOq5QHKbJ7ql+Mm37R5UVGN jkKS6/+HmcbKes2xfFbSRpNGCAmbDg8+yc+QcXS6weyHdDlfzek3aFYlqVZEBRQrbJImmJj1h fnTEh9qQ9lOcGAzsDjhOyaqrBNGmZWp5l/K3pj+FxcVJXAVbFc87SZCoC8WlK4aBz6l6axl1J jGNgG8ssbMOaKF+u7Sfi0zHTjtRaP6iFfgmNiXAu8hujwuJ7th3TYcVvTpTi8iyJ5mgSzRkXW u0fZQL+IabVTybiXv0hIhL2f7rmZB0Sk1ByWP5nAL19QIyROeVDwdYVVFujwCFKW0881T435v FemHde+0Y86btsKd8q1tYcKdpR8OSCy38ZscmWHN2VimH2bK3DvOgGFkXKC2TndRswluPaUQ8 pRys3z1wn7qUHF7gq1+22a5Ez51UKfeZWQMC96l2k+OLatgJhCnoO9Y313XFhQNODqf4sGSOT EGR4ePnC8q9QvE9DFo4fdTVJ2BuP6TRmusIy8XLGEXFvaYPoFdvjOhAdLBtB2ynWGcJwM3qlX ikon9T9kaa7LnRb/5o1AYslfc1sADLSPY8MOxpYuabZD/cE4GOjLdKoAOa+Q/Nz6HtQaLGwZ0 U80udziTvwNVQOt6P6j35N43xcHsH7nkwrf3br5VBMmJ8yDI882W8hpXDRATdle89EUcLbIiY vAgcMq9Yk5Oq2NYI1tFRp3WZryOMe6f0mDM6EVlAysLkYk87WqSJb9WvxZ1JceomrZOcKstm+ OJD2nir4xMBp62y3jXUdGvCoLC2ENSZdvzCkfnrUZJ7jKcUiFTEDen0lwDKXoCMqb31jvhUge ydmzQpYZZxfp7MNHILsofMZXFlg= Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org When git archive is started in a subdirectory, it archives its corresponding tree and its child objects, only. That is intended. It does that by effectively cd'ing into that tree and setting "prefix" to the empty string. This has unfortunate consequences, though: Attributes are anchored at the root of the repository and git archive still applies them to subtrees, causing mismatches. And when checking pathspecs it cannot tell the difference between one that doesn't match anything and one that matches something outside of the subdirectory, leading to a confusing error message. Fix that by keeping the "prefix" value and passing it to functions related to pathspecs and attributes, and shortening the paths written to the archive and (if --verbose is given) to stdout using relative_path(). Still reject attempts to archive files outside the current directory, but print a more specific error in that case. Recognizing it requires a full traversal of the subtree for each pathspec, however. Allowing them would be easier, but archive entry paths starting with "../" can be problematic to extract -- e.g. bsdtar skips them by default. Reported-by: Cristian Le Reported-by: Matthias G=C3=B6rgens Signed-off-by: Ren=C3=A9 Scharfe =2D-- archive.c | 71 +++++++++++++++++++++++++++++------------ t/t5000-tar-tree.sh | 13 ++++++++ t/t5001-archive-attr.sh | 16 ++++++++++ 3 files changed, 79 insertions(+), 21 deletions(-) diff --git a/archive.c b/archive.c index 1c2ca78e52..c8d66169d1 100644 =2D-- a/archive.c +++ b/archive.c @@ -168,6 +168,25 @@ static int write_archive_entry(const struct object_id= *oid, const char *base, args->convert =3D check_attr_export_subst(check); } + if (args->prefix) { + static struct strbuf buf =3D STRBUF_INIT; + const char *rel; + + rel =3D relative_path(path_without_prefix, args->prefix, &buf); + + /* + * We don't add an entry for the current working + * directory when we are at the root; skip it also when + * we're in a subdirectory or submodule. Skip entries + * higher up as well. + */ + if (!strcmp(rel, "./") || starts_with(rel, "../")) + return S_ISDIR(mode) ? READ_TREE_RECURSIVE : 0; + + strbuf_setlen(&path, args->baselen); + strbuf_addstr(&path, rel); + } + if (args->verbose) fprintf(stderr, "%.*s\n", (int)path.len, path.buf); @@ -403,6 +422,27 @@ static int reject_entry(const struct object_id *oid U= NUSED, return ret; } +static int reject_outside(const struct object_id *oid UNUSED, + struct strbuf *base, const char *filename, + unsigned mode, void *context) +{ + struct archiver_args *args =3D context; + struct strbuf buf =3D STRBUF_INIT; + struct strbuf path =3D STRBUF_INIT; + int ret =3D 0; + + if (S_ISDIR(mode)) + return READ_TREE_RECURSIVE; + + strbuf_addbuf(&path, base); + strbuf_addstr(&path, filename); + if (starts_with(relative_path(path.buf, args->prefix, &buf), "../")) + ret =3D -1; + strbuf_release(&buf); + strbuf_release(&path); + return ret; +} + static int path_exists(struct archiver_args *args, const char *path) { const char *paths[] =3D { path, NULL }; @@ -410,8 +450,13 @@ static int path_exists(struct archiver_args *args, co= nst char *path) int ret; ctx.args =3D args; - parse_pathspec(&ctx.pathspec, 0, 0, "", paths); + parse_pathspec(&ctx.pathspec, 0, PATHSPEC_PREFER_CWD, + args->prefix, paths); ctx.pathspec.recursive =3D 1; + if (args->prefix && read_tree(args->repo, args->tree, &ctx.pathspec, + reject_outside, args)) + die(_("pathspec '%s' matches files outside the " + "current directory"), path); ret =3D read_tree(args->repo, args->tree, &ctx.pathspec, reject_entry, &ctx); @@ -427,9 +472,8 @@ static void parse_pathspec_arg(const char **pathspec, * Also if pathspec patterns are dependent, we're in big * trouble as we test each one separately */ - parse_pathspec(&ar_args->pathspec, 0, - PATHSPEC_PREFER_FULL, - "", pathspec); + parse_pathspec(&ar_args->pathspec, 0, PATHSPEC_PREFER_CWD, + ar_args->prefix, pathspec); ar_args->pathspec.recursive =3D 1; if (pathspec) { while (*pathspec) { @@ -441,8 +485,7 @@ static void parse_pathspec_arg(const char **pathspec, } static void parse_treeish_arg(const char **argv, - struct archiver_args *ar_args, const char *prefix, - int remote) + struct archiver_args *ar_args, int remote) { const char *name =3D argv[0]; const struct object_id *commit_oid; @@ -481,20 +524,6 @@ static void parse_treeish_arg(const char **argv, if (!tree) die(_("not a tree object: %s"), oid_to_hex(&oid)); - if (prefix) { - struct object_id tree_oid; - unsigned short mode; - int err; - - err =3D get_tree_entry(ar_args->repo, - &tree->object.oid, - prefix, &tree_oid, - &mode); - if (err || !S_ISDIR(mode)) - die(_("current working directory is untracked")); - - tree =3D parse_tree_indirect(&tree_oid); - } ar_args->refname =3D ref; ar_args->tree =3D tree; ar_args->commit_oid =3D commit_oid; @@ -712,7 +741,7 @@ int write_archive(int argc, const char **argv, const c= har *prefix, setup_git_directory(); } - parse_treeish_arg(argv, &args, prefix, remote); + parse_treeish_arg(argv, &args, remote); parse_pathspec_arg(argv + 1, &args); rc =3D ar->write_archive(ar, &args); diff --git a/t/t5000-tar-tree.sh b/t/t5000-tar-tree.sh index 918a2fc7c6..a60ae6145e 100755 =2D-- a/t/t5000-tar-tree.sh +++ b/t/t5000-tar-tree.sh @@ -433,6 +433,19 @@ test_expect_success 'catch non-matching pathspec' ' test_must_fail git archive -v HEAD -- "*.abc" >/dev/null ' +test_expect_success 'reject paths outside the current directory' ' + test_must_fail git -C a/bin archive HEAD .. >/dev/null 2>err && + grep "outside the current directory" err +' + +test_expect_success 'allow pathspecs that resolve to the current director= y' ' + git -C a/bin archive -v HEAD ../bin >/dev/null 2>actual && + cat >expect <<-\EOF && + sh + EOF + test_cmp expect actual +' + # Pull the size and date of each entry in a tarfile using the system tar. # # We'll pull out only the year from the date; that avoids any question of diff --git a/t/t5001-archive-attr.sh b/t/t5001-archive-attr.sh index 04d300eeda..0ff47a239d 100755 =2D-- a/t/t5001-archive-attr.sh +++ b/t/t5001-archive-attr.sh @@ -33,6 +33,13 @@ test_expect_success 'setup' ' echo ignored-by-tree.d export-ignore >>.gitattributes && git add ignored-by-tree ignored-by-tree.d .gitattributes && + mkdir subdir && + >subdir/included && + >subdir/ignored-by-subtree && + >subdir/ignored-by-tree && + echo ignored-by-subtree export-ignore >subdir/.gitattributes && + git add subdir && + echo ignored by worktree >ignored-by-worktree && echo ignored-by-worktree export-ignore >.gitattributes && git add ignored-by-worktree && @@ -93,6 +100,15 @@ test_expect_exists archive-pathspec-wildcard/ignored-b= y-worktree test_expect_missing archive-pathspec-wildcard/excluded-by-pathspec.d test_expect_missing archive-pathspec-wildcard/excluded-by-pathspec.d/file +test_expect_success 'git -C subdir archive' ' + git -C subdir archive HEAD >archive-subdir.tar && + extract_tar_to_dir archive-subdir +' + +test_expect_exists archive-subdir/included +test_expect_missing archive-subdir/ignored-by-subtree +test_expect_missing archive-subdir/ignored-by-tree + test_expect_success 'git archive with worktree attributes' ' git archive --worktree-attributes HEAD >worktree.tar && (mkdir worktree && cd worktree && "$TAR" xf -)