* Out of memory error during git push
@ 2010-08-20 9:11 Thomas Jampen
2010-08-20 12:51 ` Jonathan Nieder
0 siblings, 1 reply; 8+ messages in thread
From: Thomas Jampen @ 2010-08-20 9:11 UTC (permalink / raw)
To: git
Hi all
I'm experiencing the following error while pushing a git repo (home
directory) to my QNAP TS-210:
user@mypc:~$ git push origin master
Counting objects: 12532, done.
Delta compression using up to 2 threads.
Compressing objects: 100% (8974/8974), done.
fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
error: pack-objects died of signal 13
error: pack-objects died with strange error
error: failed to push some refs to
'ssh://nas//share/MD0_DATA/user/repositories/backup.mypc'
I've searched the internet and found suggestions to try to repack with
lower values for 'depth', 'window' and 'windowMemory'. I used 3, 3, 50
respectively, but a push after the repack command resulted in the same
error.
I tried git fsck which reported a few dangling blobs only and I got the
same error again during the next push.
I watched /proc/meminfo and /proc/swaps on the NAS while pushing and saw
that there are always 20-50MB of free RAM and that from 512MB swap space
only about 180MB are used.
What else can I try to successfully push my repo to my NAS?
Thanks for your help,
Tom
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 9:11 Out of memory error during git push Thomas Jampen
@ 2010-08-20 12:51 ` Jonathan Nieder
2010-08-20 14:26 ` Thomas Jampen
2010-08-20 20:59 ` Nicolas Pitre
0 siblings, 2 replies; 8+ messages in thread
From: Jonathan Nieder @ 2010-08-20 12:51 UTC (permalink / raw)
To: Thomas Jampen; +Cc: git, Nicolas Pitre
(+cc: Nicolas, who knows the packing code pretty well)
Hi,
Thomas Jampen wrote:
> I'm experiencing the following error while pushing a git repo (home
> directory) to my QNAP TS-210:
>
> user@mypc:~$ git push origin master
> Counting objects: 12532, done.
> Delta compression using up to 2 threads.
> Compressing objects: 100% (8974/8974), done.
> fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
> error: pack-objects died of signal 13
What version of git are you using? Do you have overcommit accounting
enabled?
I am not sure this is the problem you are running into, but pack-objects
like many other parts of git uses mmap() to read packfiles, which can
make the address space usage high.
> I've searched the internet and found suggestions to try to repack with
> lower values for 'depth', 'window' and 'windowMemory'. I used 3, 3, 50
> respectively, but a push after the repack command resulted in the same
> error.
>
> I tried git fsck which reported a few dangling blobs only and I got the
> same error again during the next push.
>
> I watched /proc/meminfo and /proc/swaps on the NAS while pushing and saw
> that there are always 20-50MB of free RAM and that from 512MB swap space
> only about 180MB are used.
I don't know --- this is out of my depth. :)
Good luck,
Jonathan
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 12:51 ` Jonathan Nieder
@ 2010-08-20 14:26 ` Thomas Jampen
2010-08-20 14:50 ` Jonathan Nieder
2010-08-20 20:59 ` Nicolas Pitre
1 sibling, 1 reply; 8+ messages in thread
From: Thomas Jampen @ 2010-08-20 14:26 UTC (permalink / raw)
To: Jonathan Nieder; +Cc: git, Nicolas Pitre
Hi
>> I'm experiencing the following error while pushing a git repo (home
>> directory) to my QNAP TS-210:
>>
>> user@mypc:~$ git push origin master
>> Counting objects: 12532, done.
>> Delta compression using up to 2 threads.
>> Compressing objects: 100% (8974/8974), done.
>> fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
>> error: pack-objects died of signal 13
>
> What version of git are you using? Do you have overcommit accounting
> enabled?
I'm using git version 1.7.0.4 on my Kubuntu 10.04 Laptop and git version
1.7.1.1 on my QNAP NAS.
On my Laptop and on the NAS, when I execute: sudo sysctl vm.overcommit_memory
I get:
vm.overcommit_memory = 0
Do you propose to set this to '2' in order to disable overcommitting? If yes, where (on the Laptop and/or on the NAS)?
Thanks,
Tom
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 14:26 ` Thomas Jampen
@ 2010-08-20 14:50 ` Jonathan Nieder
2010-08-20 16:01 ` Thomas Jampen
2010-08-20 17:26 ` Nicolas Pitre
0 siblings, 2 replies; 8+ messages in thread
From: Jonathan Nieder @ 2010-08-20 14:50 UTC (permalink / raw)
To: Thomas Jampen; +Cc: git, Nicolas Pitre
Thomas Jampen wrote:
> vm.overcommit_memory = 0
>
> Do you propose to set this to '2' in order to disable overcommitting?
It might be interesting to try
echo 1 >/proc/sys/vm/overcommit_memory
but 0 is generally the only sane setting.
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 14:50 ` Jonathan Nieder
@ 2010-08-20 16:01 ` Thomas Jampen
2010-08-20 17:26 ` Nicolas Pitre
1 sibling, 0 replies; 8+ messages in thread
From: Thomas Jampen @ 2010-08-20 16:01 UTC (permalink / raw)
To: Jonathan Nieder; +Cc: git, Nicolas Pitre
> > vm.overcommit_memory = 0
> >
> > Do you propose to set this to '2' in order to disable
> > overcommitting?
>
> It might be interesting to try
>
> echo 1 >/proc/sys/vm/overcommit_memory
>
> but 0 is generally the only sane setting.
I set the value on both (Laptop and NAS) and got the following error:
Counting objects: 13051, done.
Delta compression using up to 2 threads.
warning: suboptimal pack - out of memory
Compressing objects: 100% (9848/9848), done.
error: index-pack died of signal 9), 1.27 GiB | 308 KiB/s
error: pack-objects died of signal 13
error: pack-objects died with strange error
error: failed to push some refs to 'ssh://...'
Any ideas?
Tom
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 14:50 ` Jonathan Nieder
2010-08-20 16:01 ` Thomas Jampen
@ 2010-08-20 17:26 ` Nicolas Pitre
1 sibling, 0 replies; 8+ messages in thread
From: Nicolas Pitre @ 2010-08-20 17:26 UTC (permalink / raw)
To: Jonathan Nieder; +Cc: Thomas Jampen, git
On Fri, 20 Aug 2010, Jonathan Nieder wrote:
> Thomas Jampen wrote:
>
> > vm.overcommit_memory = 0
> >
> > Do you propose to set this to '2' in order to disable overcommitting?
>
> It might be interesting to try
>
> echo 1 >/proc/sys/vm/overcommit_memory
>
> but 0 is generally the only sane setting.
Don't know the meaning for specific values, but you definitively don't
want to turn off memory overcommit.
Nicolas
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 12:51 ` Jonathan Nieder
2010-08-20 14:26 ` Thomas Jampen
@ 2010-08-20 20:59 ` Nicolas Pitre
2010-08-20 21:21 ` Thomas Jampen
1 sibling, 1 reply; 8+ messages in thread
From: Nicolas Pitre @ 2010-08-20 20:59 UTC (permalink / raw)
To: Jonathan Nieder; +Cc: Thomas Jampen, git
On Fri, 20 Aug 2010, Jonathan Nieder wrote:
> (+cc: Nicolas, who knows the packing code pretty well)
>
> Hi,
>
> Thomas Jampen wrote:
>
> > I'm experiencing the following error while pushing a git repo (home
> > directory) to my QNAP TS-210:
> >
> > user@mypc:~$ git push origin master
> > Counting objects: 12532, done.
> > Delta compression using up to 2 threads.
> > Compressing objects: 100% (8974/8974), done.
> > fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
> > error: pack-objects died of signal 13
How much memory is there on the machine where the pushed data is going?
Nicolas
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Out of memory error during git push
2010-08-20 20:59 ` Nicolas Pitre
@ 2010-08-20 21:21 ` Thomas Jampen
0 siblings, 0 replies; 8+ messages in thread
From: Thomas Jampen @ 2010-08-20 21:21 UTC (permalink / raw)
To: Nicolas Pitre; +Cc: Jonathan Nieder, git
On 20.08.2010 22:59, Nicolas Pitre wrote:
> On Fri, 20 Aug 2010, Jonathan Nieder wrote:
>
>> (+cc: Nicolas, who knows the packing code pretty well)
>>
>> Hi,
>>
>> Thomas Jampen wrote:
>>
>>> I'm experiencing the following error while pushing a git repo (home
>>> directory) to my QNAP TS-210:
>>>
>>> user@mypc:~$ git push origin master
>>> Counting objects: 12532, done.
>>> Delta compression using up to 2 threads.
>>> Compressing objects: 100% (8974/8974), done.
>>> fatal: Out of memory, malloc failed, 986.06 MiB | 1.65 MiB/s
>>> error: pack-objects died of signal 13
>
> How much memory is there on the machine where the pushed data is going?
My NAS has 256MB RAM. While the push is running, there is between
20-50MB RAM available according to MemFree reported by 'head
/proc/meminfo'. The harddrive space should not be an issue, its about 2TB.
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2010-08-20 21:21 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-08-20 9:11 Out of memory error during git push Thomas Jampen
2010-08-20 12:51 ` Jonathan Nieder
2010-08-20 14:26 ` Thomas Jampen
2010-08-20 14:50 ` Jonathan Nieder
2010-08-20 16:01 ` Thomas Jampen
2010-08-20 17:26 ` Nicolas Pitre
2010-08-20 20:59 ` Nicolas Pitre
2010-08-20 21:21 ` Thomas Jampen
Code repositories for project(s) associated with this public inbox
https://80x24.org/mirrors/git.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).