From: Jeff King <peff@peff.net>
To: Matthieu Moy <Matthieu.Moy@imag.fr>
Cc: Git Mailing List <git@vger.kernel.org>
Subject: Re: People unaware of the importance of "git gc"?
Date: Wed, 5 Sep 2007 19:56:53 -0400 [thread overview]
Message-ID: <20070905235653.GB25001@coredump.intra.peff.net> (raw)
In-Reply-To: <vpq1wddkohr.fsf@bauges.imag.fr>
On Wed, Sep 05, 2007 at 07:31:44PM +0200, Matthieu Moy wrote:
> I have ~/teaching/some-course/.git (well, almost) and ~/etc/.git which
> are two unrelated projects, and to "git gc" both of them, I need
> either a script, or two manual invocations.
>
> (yes, I'm really talking about something trivial)
I tend to have a lot of small projects, so I have on the order of 80 git
repositories on each machine I use, most of which have a 'mothership'
origin on a central, backed-up machine.
When I sit down to work, I want to see which repositories
have changes that need to be pulled. And when I get up to leave, I want
to see which repositories have changes that need to be pushed. Not to
mention files that need committed, loose objects that need packed, etc.
So I wrote the 'git-stale' script, included below. It's not especially
user-friendly, but you might find it useful, as it solves the exact
problem you are talking about (and much more).
It reads 'repository specifications' from ~/.gitstale, one per line,
which are either of the form:
/path/to/repo
which specifies a repo to check, or:
r:/path/to/many/repos
which specifies a hierarchy in which to recursively find repos.
My .gitstale looks something like this:
/home/peff/compile/git
/home/peff/compile/tig
r:/home/peff/work
and I get output something like this (edited for brevity):
Checking (1/77) /home/peff/compile/git...
Checking (2/77) /home/peff/compile/tig...
[...]
Checking (77/77) /home/peff/work/foo...
MERGE:next /home/peff/compile/git
COMMIT: /home/peff/work/foo
PACK: /home/peff/work/foo
PUSH:master /home/peff/work/bar
which translates to:
- the git repo has commits in 'origin/next' that are not in 'next'
(and you might want to merge them in)
- there are uncommitted files in 'foo'
- 'foo' needs packing
- in the 'bar' repo there are commits in master that are not in origin
(and you might want to push)
Hopefully it will be useful to you, though I think it is probably too
specific to my workflow to be part of git.
-Peff
-- >8 --
#!/usr/bin/perl
use strict;
use Getopt::Long;
my $CONFIG_FILE = "$ENV{HOME}/.gitstale";
my $nofetch = $ENV{GITSTALE_NOFETCH};
Getopt::Long::Configure(qw(bundling));
GetOptions('nofetch|n!' => \$nofetch) or exit 100;
my @projects = process_spec(@ARGV ? @ARGV : cat($CONFIG_FILE));
my $n = 1;
my $total = @projects;
my %errors;
foreach my $p (@projects) {
print "Checking ($n/$total) $p...\n";
$errors{$p} = [check_git($p)];
$n++;
}
my $errcount;
foreach my $p (@projects) {
foreach my $e (@{$errors{$p}}) {
print "$e: $p\n";
}
}
exit $errcount ? 1 : 0;
sub cat {
my $fn = shift;
open(my $fh, '<', $fn)
or die "unable to open $fn: $!\n";
return map { chomp; length($_) ? $_ : () } <$fh>;
}
sub process_spec {
my @dirs;
my @roots;
my @exclude;
foreach (@_) {
if(/^r:(.*)/) { push @roots, $1 }
elsif(/^d:(.*)/) { push @dirs, $1 }
elsif(/^-(.*)/) { push @exclude, qr#(^|/)$1($|/)# }
else { push @dirs, $_ }
}
use File::Find;
find({
no_chdir => 1,
preprocess => sub { sort @_ },
wanted => sub {
return unless -d $_ && $_ =~ m#/.git$#;
foreach my $e (@exclude) { return if $_ =~ $e }
my $d = $_;
$d =~ s#/\.git$##;
push @dirs, $d;
}
}, @roots) if @roots;
return @dirs;
}
sub count_zero {
open(my $fh, '-|', @_) or die "unable to fork: $!\n";
my $line = <$fh>;
return length($line) == 0;
}
sub check_git {
my $d = shift;
chdir($d) or return 'CHDIR';
my @r;
count_zero(qw(
git-ls-files -m -o -d --exclude-per-directory=.gitignore
--directory --no-empty-directory
)) or push @r, 'COMMIT';
if(has_origin()) {
push @r, 'FETCH' if !$nofetch && system('git-fetch');
foreach my $p (branch_pairs()) {
count_zero('git-rev-list', "$p->[0]..$p->[1]")
or push @r, "MERGE:$p->[0]";
count_zero('git-rev-list', "$p->[1]..$p->[0]")
or push @r, "PUSH:$p->[0]";
}
}
else {
push @r, 'ORIGIN';
}
push @r, 'PACK' if unpacked_objects() > 1000;
return @r;
}
sub unpacked_objects {
my $objects = `git-count-objects`;
$objects =~ /^(\d+)/;
return $1;
}
sub branch_pairs {
my %config;
foreach my $line (`git-repo-config --get-regexp 'branch..*..*'`) {
$line =~ m#^branch\.([^.]+)\.([^ ]+) (?:refs/heads/)?(.*)#
or die "confusing git-repo-config output: $line\n";
$config{$1}{$2} = $3;
}
return [qw(master origin)] if -e '.git/refs/heads/origin';
return
(-e '.git/refs/heads/origin' ? [qw(master origin)] : ()),
map {
$config{$_}{remote} && $config{$_}{merge} ?
[$_, $config{$_}{remote} . '/' . $config{$_}{merge}] :
()
} sort keys(%config);
}
sub has_origin {
return
-e '.git/branches/origin' ||
-e '.git/remotes/origin' ||
!count_zero(qw(git-repo-config --get remote.origin.url));
}
__END__
next prev parent reply other threads:[~2007-09-05 23:57 UTC|newest]
Thread overview: 97+ messages / expand[flat|nested] mbox.gz Atom feed top
2007-09-05 7:09 People unaware of the importance of "git gc"? Linus Torvalds
2007-09-05 7:21 ` Martin Langhoff
2007-09-05 7:37 ` Karl Hasselström
2007-09-05 7:30 ` Junio C Hamano
2007-09-05 7:26 ` Tomash Brechko
2007-09-05 8:13 ` Johan Herland
2007-09-05 8:39 ` Matthieu Moy
2007-09-05 8:41 ` Johan Herland
2007-09-05 8:47 ` David Kastrup
2007-09-05 8:51 ` Pierre Habouzit
2007-09-05 9:02 ` David Kastrup
2007-09-05 9:04 ` Matthieu Moy
2007-09-05 8:51 ` Wincent Colaiuta
2007-09-05 7:42 ` Pierre Habouzit
2007-09-05 8:16 ` Junio C Hamano
2007-09-05 8:50 ` Steven Grimm
[not found] ` <86ps0xcwxo.fsf@lola.quinscape.zz>
2007-09-05 9:07 ` Steven Grimm
2007-09-05 9:13 ` David Kastrup
2007-09-05 9:07 ` Junio C Hamano
2007-09-05 9:27 ` Martin Langhoff
2007-09-05 9:33 ` Matthieu Moy
2007-09-05 14:17 ` Johan De Messemaeker
2007-09-05 17:31 ` Matthieu Moy
2007-09-05 23:56 ` Jeff King [this message]
2007-09-05 9:13 ` David Kastrup
2007-09-05 9:14 ` Pierre Habouzit
2007-09-05 17:51 ` Nix
2007-09-05 18:14 ` Steven Grimm
2007-09-05 18:22 ` Nix
2007-09-05 18:54 ` Nicolas Pitre
2007-09-05 20:01 ` Junio C Hamano
2007-09-05 20:35 ` Nicolas Pitre
2007-09-05 21:14 ` Nix
2007-09-05 21:46 ` Junio C Hamano
2007-09-05 23:04 ` Nicolas Pitre
2007-09-05 23:42 ` Junio C Hamano
2007-09-06 0:27 ` Carlos Rica
2007-09-06 5:55 ` David Kastrup
2007-09-05 21:49 ` Junio C Hamano
2007-09-05 21:59 ` Invoke "git gc --auto" from commit, merge, am and rebase Junio C Hamano
2007-09-06 2:39 ` Shawn O. Pearce
2007-09-05 20:37 ` [PATCH] Invoke "git gc --auto" from "git add" and "git fetch" Junio C Hamano
[not found] ` <69b0c0350709051357ifa547aarfe3e0b36cf9be98f@mail.gmail.com>
2007-09-05 20:59 ` Fwd: " Govind Salinas
2007-09-06 12:02 ` Johannes Schindelin
2007-09-05 21:18 ` People unaware of the importance of "git gc"? Alex Riesen
2007-09-06 2:44 ` Russ Dill
2007-09-06 2:52 ` Shawn O. Pearce
2007-09-06 9:28 ` Andreas Ericsson
2007-09-06 2:45 ` Shawn O. Pearce
2007-09-06 2:49 ` Steven Grimm
2007-09-06 2:56 ` Shawn O. Pearce
2007-09-06 15:54 ` Johannes Schindelin
2007-09-06 17:49 ` Junio C Hamano
2007-09-06 18:15 ` Linus Torvalds
2007-09-06 18:29 ` Steven Grimm
2007-09-06 23:12 ` Subject: [PATCH] git-merge-pack Junio C Hamano
2007-09-06 23:35 ` Linus Torvalds
2007-09-07 0:51 ` Nicolas Pitre
2007-09-07 1:58 ` Junio C Hamano
2007-09-07 2:32 ` Nicolas Pitre
2007-09-07 4:07 ` Shawn O. Pearce
2007-09-07 4:43 ` Junio C Hamano
2007-09-08 9:50 ` [PATCH] make sha1_file.c::matches_pack_name() available to others Junio C Hamano
2007-09-08 10:01 ` [PATCH] pack-objects --repack-unpacked Junio C Hamano
2007-09-07 7:11 ` Subject: [PATCH] git-merge-pack Johannes Sixt
2007-09-07 7:34 ` Junio C Hamano
2007-09-07 7:24 ` Andy Parkins
2007-09-07 4:48 ` People unaware of the importance of "git gc"? Shawn O. Pearce
2007-09-07 10:12 ` Johannes Schindelin
2018-10-07 18:28 ` What's so special about objects/17/ ? Ævar Arnfjörð Bjarmason
2018-10-07 18:35 ` Johannes Sixt
2018-10-07 19:06 ` Ævar Arnfjörð Bjarmason
2018-10-07 22:39 ` Johannes Sixt
2018-10-08 0:54 ` Junio C Hamano
2018-10-07 19:46 ` Junio C Hamano
2018-10-07 20:07 ` Junio C Hamano
2018-10-08 19:17 ` Stefan Beller
2018-10-09 1:03 ` Junio C Hamano
2018-10-09 17:37 ` Stefan Beller
2018-10-10 1:10 ` Junio C Hamano
2018-10-10 19:08 ` Stefan Beller
2018-10-08 10:36 ` Ævar Arnfjörð Bjarmason
2018-10-09 1:07 ` Junio C Hamano
2018-10-09 17:40 ` Stefan Beller
2007-09-05 8:16 ` People unaware of the importance of "git gc"? David Kastrup
2007-09-05 16:47 ` Govind Salinas
2007-09-05 17:19 ` Carl Worth
2007-09-05 17:55 ` Jing Xue
2007-09-05 17:35 ` Steven Grimm
2007-09-05 18:28 ` Nix
2007-09-05 17:44 ` J. Bruce Fields
2007-09-05 18:46 ` Brandon Casey
2007-09-05 19:09 ` David Kastrup
2007-09-05 19:13 ` J. Bruce Fields
2007-09-05 19:43 ` David Kastrup
2007-09-05 19:20 ` Mike Hommey
2007-09-05 21:07 ` Alex Riesen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: http://vger.kernel.org/majordomo-info.html
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20070905235653.GB25001@coredump.intra.peff.net \
--to=peff@peff.net \
--cc=Matthieu.Moy@imag.fr \
--cc=git@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).