Re: too many open files

[fmiser <fmiser@gmail.com>]

> Peter wrote:

> sox FAIL formats: can’t open input file ‘whatever.wav’ : Too
> many open files

> I tried to work around this by recursively concatenating each
> input file to a common (growing) output file using a simple bash
> until loop. The performance penalty of this is enormous, as the
> same output file has to be opened, read and written each time
> again.
>
> I am curious what a possible workaround could be, other than
> dividing above task between multiple calls of sox, each with a
> reduced number of files.

I can't help with the SoX source.  But what I would try first if I
were facing that problem is to concatenate in bunches.

For example, take the first 1000 and concatenate them into 01.wav,
then the second 1000 into 02.wav, then finally concatenate 01.wav,
02.wav, etc.

Maybe put the initial groupings into subdirectories to be sure
each file is included only once.

$ mv -nv $(ls path/name/ | head -n 1000) subdir/


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi
_______________________________________________
Sox-users mailing list
Sox-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sox-users