git@vger.kernel.org mailing list mirror (one of many)
 help / color / mirror / code / Atom feed
From: Jonathan Tan <jonathantanmy@google.com>
To: gitster@pobox.com
Cc: jonathantanmy@google.com, git@vger.kernel.org, me@ttaylorr.com,
	newren@gmail.com, emilyshaffer@google.com
Subject: Re: [PATCH v2 4/4] promisor-remote: teach lazy-fetch in any repo
Date: Tue,  8 Jun 2021 21:39:50 -0700	[thread overview]
Message-ID: <20210609043950.2325124-1-jonathantanmy@google.com> (raw)
In-Reply-To: <xmqqim2pq8kj.fsf@gitster.g>

> Jonathan Tan <jonathantanmy@google.com> writes:
> 
> >  		/* Check if it is a missing object */
> > -		if (fetch_if_missing && has_promisor_remote() &&
> > -		    !already_retried && r == the_repository &&
> > +		if (fetch_if_missing && repo_has_promisor_remote(r) &&
> > +		    !already_retried &&
> 
> Turning has_promisor_remote() into repo_has_promisor_remote(r) does
> make tons of sense.  Is this part of the code ready to lose "'r' must
> be the_repository because has_promisor_remote() only works on the
> primary in-core repository" we had before?

Yes - that is precisely what I test with the test helper (running this
code path with "r" that is not the_repository).

> > @@ -21,6 +22,11 @@ static int fetch_objects(const char *remote_name,
> >  
> >  	child.git_cmd = 1;
> >  	child.in = -1;
> > +	if (repo != the_repository) {
> > +		prepare_other_repo_env(&child.env_array);
> > +		strvec_pushf(&child.env_array, "%s=%s", GIT_DIR_ENVIRONMENT,
> > +			     repo->gitdir);
> > +	}
> 
> This is what prepare_submodule_repo_env_in_gitdir() does; it makes
> me wonder if it (i.e. set up environment for that other repository,
> including the GIT_DIR and possibly other per-repository environment
> variable override) should be the primary API callers would want,
> instead of a more limited prepare_other_repo_env() that does not
> even take 'repo' parameter.  Doesn't it feel somewhat strange for a
> function that is supposed to help preparing a part of child process
> by filling appropriate environ[] array to be run in a repository
> that is different from ours (which is "other repo" part of its name)
> not to want to even know which repository the "other" repo is?

Good point. I'll update prepare_other_repo_env() to have a gitdir
parameter.

> > diff --git a/t/helper/test-partial-clone.c b/t/helper/test-partial-clone.c
> > new file mode 100644
> > index 0000000000..3f102cfddd
> > --- /dev/null
> > +++ b/t/helper/test-partial-clone.c
> > @@ -0,0 +1,43 @@
> > +#include "cache.h"
> > +#include "test-tool.h"
> > +#include "repository.h"
> > +#include "object-store.h"
> > +
> > +/*
> > + * Prints the size of the object corresponding to the given hash in a specific
> > + * gitdir. This is similar to "git -C gitdir cat-file -s", except that this
> > + * exercises the code that accesses the object of an arbitrary repository that
> > + * is not the_repository. ("git -C gitdir" makes it so that the_repository is
> > + * the one in gitdir.)
> > + */
> 
> The reason why this only gives size is because it will eventually
> become unnecessary once the main code starts running things in a
> submodule repository properly (i.e. without doing the alternate odb
> thing),

If you mean that this code path can be tested through user-visible
commands (e.g. git grep with submodule recursion) once the main code
starts avoiding doing the alternate odb thing, so this helper will
eventually be unnecessary, then the answer is yes.

> and a more elaborate check is not worth your engineering
> effort?

Even now, I don't think a more elaborate check is worth the engineering
effort - I just want to check that the file indeed was lazy-fetched, so
any minor datum would suffice.

> Object type and object sizes are something that you can
> safely express in plain text, would be handy for testing, and would
> not require too much extra code, I'd imagine.

It would, but we can already use "git cat-file -s" (or -t) for that. The
helper is meant to test a specific code path wherein we access a
submodule object during a process running in the superproject.

> > +	printf("%d\n", (int) size);
> 
> Mimicking what builtin/cat-file.c::cat_one_file() does, for example, and
> using
> 
> 	printf("%"PRIuMAX"\n", (uintmax_t)size);
> 
> might be better (I was wondering if we can extract reusable helpers,
> but I do not think that is worth doing, if this is meant to be
> temporary stop-gap measure).
> 
> Thanks.

Sounds good - I'll change this.

  reply	other threads:[~2021-06-09  4:42 UTC|newest]

Thread overview: 77+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-06-01 21:34 [PATCH 0/4] First steps towards partial clone submodules Jonathan Tan
2021-06-01 21:34 ` [PATCH 1/4] promisor-remote: read partialClone config here Jonathan Tan
2021-06-04 19:56   ` Taylor Blau
2021-06-05  1:38     ` Jonathan Tan
2021-06-07 22:41   ` Emily Shaffer
2021-06-01 21:34 ` [PATCH 2/4] promisor-remote: support per-repository config Jonathan Tan
2021-06-04 20:09   ` Taylor Blau
2021-06-05  1:43     ` Jonathan Tan
2021-06-04 21:21   ` Elijah Newren
2021-06-05  1:54     ` Jonathan Tan
2021-06-08  0:48   ` Emily Shaffer
2021-06-01 21:34 ` [PATCH 3/4] run-command: move envvar-resetting function Jonathan Tan
2021-06-04 20:19   ` Taylor Blau
2021-06-05  1:57     ` Jonathan Tan
2021-06-08  0:54   ` Emily Shaffer
2021-06-01 21:34 ` [PATCH 4/4] promisor-remote: teach lazy-fetch in any repo Jonathan Tan
2021-06-04 21:25   ` Taylor Blau
2021-06-05  2:11     ` Jonathan Tan
2021-06-04 21:35   ` Elijah Newren
2021-06-05  2:16     ` Jonathan Tan
2021-06-05  3:48     ` Elijah Newren
2021-06-05  0:22   ` Elijah Newren
2021-06-05  2:16     ` Jonathan Tan
2021-06-08  1:41   ` Emily Shaffer
2021-06-09  4:52     ` Jonathan Tan
2021-06-08  0:25 ` [PATCH v2 0/4] First steps towards partial clone submodules Jonathan Tan
2021-06-08  0:25   ` [PATCH v2 1/4] promisor-remote: read partialClone config here Jonathan Tan
2021-06-08  3:18     ` Junio C Hamano
2021-06-09  4:26       ` Jonathan Tan
2021-06-09  9:30         ` Junio C Hamano
2021-06-09 17:16           ` Jonathan Tan
2021-06-08 17:28     ` Elijah Newren
2021-06-09  4:44       ` Jonathan Tan
2021-06-09  5:34         ` Elijah Newren
2021-06-10 17:25           ` Jonathan Tan
2021-06-08  0:25   ` [PATCH v2 2/4] promisor-remote: support per-repository config Jonathan Tan
2021-06-08  3:30     ` Junio C Hamano
2021-06-09  4:29       ` Jonathan Tan
2021-06-08  0:25   ` [PATCH v2 3/4] run-command: move envvar-resetting function Jonathan Tan
2021-06-08  4:14     ` Junio C Hamano
2021-06-09  4:32       ` Jonathan Tan
2021-06-09  5:28         ` Junio C Hamano
2021-06-09 18:15           ` Jonathan Tan
2021-06-08  0:25   ` [PATCH v2 4/4] promisor-remote: teach lazy-fetch in any repo Jonathan Tan
2021-06-08  4:33     ` Junio C Hamano
2021-06-09  4:39       ` Jonathan Tan [this message]
2021-06-09  5:33         ` Junio C Hamano
2021-06-09 18:20           ` Jonathan Tan
2021-06-10  1:26             ` Junio C Hamano
2021-06-08 17:42     ` Elijah Newren
2021-06-09  4:46       ` Jonathan Tan
2021-06-08 17:50   ` [PATCH v2 0/4] First steps towards partial clone submodules Elijah Newren
2021-06-08 23:42     ` Junio C Hamano
2021-06-09  0:07       ` Elijah Newren
2021-06-09  0:18         ` Junio C Hamano
2021-06-09  4:58     ` Jonathan Tan
2021-06-08  1:44 ` [PATCH " Emily Shaffer
2021-06-10 17:35 ` [PATCH v3 0/5] " Jonathan Tan
2021-06-10 17:35   ` [PATCH v3 1/5] repository: move global r_f_p_c to repo struct Jonathan Tan
2021-06-10 20:47     ` Elijah Newren
2021-06-10 17:35   ` [PATCH v3 2/5] promisor-remote: support per-repository config Jonathan Tan
2021-06-10 17:35   ` [PATCH v3 3/5] submodule: refrain from filtering GIT_CONFIG_COUNT Jonathan Tan
2021-06-10 21:13     ` Elijah Newren
2021-06-10 21:51       ` Jeff King
2021-06-11 17:02         ` Jonathan Tan
2021-06-10 17:35   ` [PATCH v3 4/5] run-command: refactor subprocess env preparation Jonathan Tan
2021-06-10 21:21     ` Elijah Newren
2021-06-10 17:35   ` [PATCH v3 5/5] promisor-remote: teach lazy-fetch in any repo Jonathan Tan
2021-06-10 21:29   ` [PATCH v3 0/5] First steps towards partial clone submodules Elijah Newren
2021-06-15 21:22     ` Elijah Newren
2021-06-17 17:13 ` [PATCH v4 " Jonathan Tan
2021-06-17 17:13   ` [PATCH v4 1/5] repository: move global r_f_p_c to repo struct Jonathan Tan
2021-06-17 17:13   ` [PATCH v4 2/5] promisor-remote: support per-repository config Jonathan Tan
2021-06-17 17:13   ` [PATCH v4 3/5] submodule: refrain from filtering GIT_CONFIG_COUNT Jonathan Tan
2021-06-17 17:13   ` [PATCH v4 4/5] run-command: refactor subprocess env preparation Jonathan Tan
2021-06-17 17:13   ` [PATCH v4 5/5] promisor-remote: teach lazy-fetch in any repo Jonathan Tan
2021-06-19 20:01   ` [PATCH v4 0/5] First steps towards partial clone submodules Elijah Newren

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: http://vger.kernel.org/majordomo-info.html

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20210609043950.2325124-1-jonathantanmy@google.com \
    --to=jonathantanmy@google.com \
    --cc=emilyshaffer@google.com \
    --cc=git@vger.kernel.org \
    --cc=gitster@pobox.com \
    --cc=me@ttaylorr.com \
    --cc=newren@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this public inbox

	https://80x24.org/mirrors/git.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).