From: Johannes Schindelin <Johannes.Schindelin@gmx.de>
To: Kim Gybels <kgybels@infogroep.be>
Cc: git@vger.kernel.org, Junio C Hamano <gitster@pobox.com>,
Jeff King <peff@peff.net>, Oleg Gubanov <oleg.gubanov@gmail.com>
Subject: Re: [PATCH 2/2] daemon: graceful shutdown of client connection
Date: Wed, 18 Apr 2018 23:48:22 +0200 (DST) [thread overview]
Message-ID: <nycvar.QRO.7.76.6.1804182316420.4241@ZVAVAG-6OXH6DA.rhebcr.pbec.zvpebfbsg.pbz> (raw)
In-Reply-To: <20180415202122.GA4657@infogroep.be>
Hi Kim,
On Sun, 15 Apr 2018, Kim Gybels wrote:
> On (13/04/18 15:03), Johannes Schindelin wrote:
> > I wonder whether you found a reliable way to trigger this? It would be
> > nice to have a regression test for this.
>
> On my system, it reproduced reliably using Oleg's example [1], below is
> my bash version of it.
Okay.
> Script to generate repository with some history:
>
> $ cat example.sh
> #!/bin/bash
>
> git init example
> cd example
>
> git --help > foo.txt
>
> for i in $(seq 1 12); do
> cat foo.txt foo.txt > bar.txt
> mv bar.txt foo.txt
> git add foo.txt
> git commit -m v$i
> done
Okay, so this sets up a minimal repository with a moderate size, inflating
foo.txt from the initial Git help text by factor 2**12 = 4096. The help
text is around 2kB, so we end up with an ~8MB large file in the end that
grew exponentially.
> $ ./example.sh
> Initialized empty Git repository in C:/git/bug/example/.git/
> [master (root-commit) 2e44b4a] v1
> 1 file changed, 84 insertions(+)
> create mode 100644 foo.txt
> [master 9791332] v2
> 1 file changed, 84 insertions(+)
> [master 524e672] v3
> 1 file changed, 168 insertions(+)
> [master afec6ef] v4
> 1 file changed, 336 insertions(+)
> [master 1bcd9cc] v5
> 1 file changed, 672 insertions(+)
> [master 2f38a8e] v6
> 1 file changed, 1344 insertions(+)
> [master 33382fe] v7
> 1 file changed, 2688 insertions(+)
> [master 6c2cbd6] v8
> 1 file changed, 5376 insertions(+)
> [master 8d0770f] v9
> 1 file changed, 10752 insertions(+)
> [master 517d650] v10
> 1 file changed, 21504 insertions(+)
> [master 9e12406] v11
> 1 file changed, 43008 insertions(+)
> [master 4c4f600] v12
> 1 file changed, 86016 insertions(+)
>
> Server side:
>
> $ git daemon --verbose --reuseaddr --base-path=$(pwd) --export-all
> [4760] Ready to rumble
> [696] Connection from 127.0.0.1:2054
> [696] unable to set SO_KEEPALIVE on socket: No such file or directory
> [696] Extended attribute "host": 127.0.0.1
> [696] Request upload-pack for '/example'
I guess apart from the generated repo size (which would make this an
expensive test in and of itself), the fact that we have to run the daemon
(and that lib-git-daemon.sh requires the PIPE prerequisite which we
disabled on Windows) makes it hard to turn this into a regular regression
test in t/.
Although we *could* of course introduce a test that does not use
lib-git-daemon.sh and is hidden behind the EXPENSIVE prerequisite or some
such.
BTW I just tested this, and it indeed fixes the problem, so I am eager to
ship it to the Git for Windows users. Let's see whether we can convince
Junio that your quite small and easy-to-review patches are not too much of
a maintenance burden, and the fact that they fix a long-standing bug
should help.
BTW I had to apply this to build with DEVELOPER=1:
diff --git a/daemon.c b/daemon.c
index 97fadd62d10..1cc901e9739 100644
--- a/daemon.c
+++ b/daemon.c
@@ -1162,13 +1162,13 @@ static int service_loop(struct socketlist
*socklist)
signal(SIGCHLD, child_handler);
for (;;) {
- int i;
+ int i, ret;
check_dead_children();
#ifdef NO_POLL
poll_timeout = live_children ? 100 : -1;
#endif
- int ret = poll(pfd, socklist->nr, poll_timeout);
+ ret = poll(pfd, socklist->nr, poll_timeout);
if (ret == 0) {
continue;
} else if (ret < 0) {
Would you mind squashing that in?
Thanks,
Dscho
prev parent reply other threads:[~2018-04-18 21:49 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-04-12 21:07 [PATCH 0/2] Fix early EOF with GfW daemon Kim Gybels
2018-04-12 21:07 ` [PATCH 1/2] daemon: use timeout for uninterruptible poll Kim Gybels
2018-04-13 12:36 ` Johannes Schindelin
2018-04-15 17:08 ` Kim Gybels
2018-04-18 21:16 ` Johannes Schindelin
2018-04-15 21:54 ` Junio C Hamano
2018-04-15 22:16 ` Junio C Hamano
2018-04-18 21:07 ` Johannes Schindelin
2018-04-18 21:51 ` Junio C Hamano
2018-04-19 21:33 ` Kim Gybels
2018-04-19 23:18 ` Junio C Hamano
2018-04-12 21:07 ` [PATCH 2/2] daemon: graceful shutdown of client connection Kim Gybels
2018-04-13 13:03 ` Johannes Schindelin
2018-04-15 20:21 ` Kim Gybels
2018-04-18 21:48 ` Johannes Schindelin [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: http://vger.kernel.org/majordomo-info.html
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=nycvar.QRO.7.76.6.1804182316420.4241@ZVAVAG-6OXH6DA.rhebcr.pbec.zvpebfbsg.pbz \
--to=johannes.schindelin@gmx.de \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=kgybels@infogroep.be \
--cc=oleg.gubanov@gmail.com \
--cc=peff@peff.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).