[ruby-core:70379] [Ruby trunk - Bug #11444] [Open] STDIN.each_codepoint hangs indefinitely on certain codepoints

[ruby-core:70379] [Ruby trunk - Bug #11444] [Open] STDIN.each_codepoint hangs indefinitely on certain codepoints

[andrew]

Issue #11444 has been reported by Andrew Cantino.

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444

* Author: Andrew Cantino
* Status: Open
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: UNKNOWN, 2.1: UNKNOWN, 2.2: UNKNOWN
----------------------------------------
Piping certain Unicode data into Ruby and calling each_codepoint on STDIN results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:70396] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[nobu]

Issue #11444 has been updated by Nobuyoshi Nakada.

Description updated
Backport changed from 2.0.0: UNKNOWN, 2.1: UNKNOWN, 2.2: UNKNOWN to 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-53797

* Author: Andrew Cantino
* Status: Open
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:70397] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[andrew]

Issue #11444 has been updated by Andrew Cantino.


Nobuyoshi Nakada wrote:
> Applied in changeset r51583.
> 
> ----------
> io.c: read more data
> 
> * io.c (rb_io_each_codepoint): read more data when read partially.
>   [ruby-core:70379] [Bug #11444]

Thank you for fixing this, and in less than 24 hours!

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-53799

* Author: Andrew Cantino
* Status: Closed
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:71732] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[nagachika00]

Issue #11444 has been updated by Tomoyuki Chikanaga.

Backport changed from 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED to 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: DONE

Backported r51583 and r51638 into `ruby_2_2` at r52786.
I didn't backport r51594 because it introduce an incompatibility.

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-55137

* Author: Andrew Cantino
* Status: Closed
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: DONE
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:71739] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[usa]

Issue #11444 has been updated by Usaku NAKAMURA.

Backport changed from 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: DONE to 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED

Tomoyuki Chikanaga wrote:
> I didn't backport r51594 because it introduce an incompatibility.

But without r51549, the test never pass on mswin.
See http://ruby-mswin.cloudapp.net/vc10-x64/ruby-2.2/log/20151129T090947Z.log.html.gz#rubyspec

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-55143

* Author: Andrew Cantino
* Status: Closed
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:71747] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[nagachika00]

Issue #11444 has been updated by Tomoyuki Chikanaga.


usa san: Thank you for your notice.
Hmm, I will backport r51594.

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-55151

* Author: Andrew Cantino
* Status: Closed
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:71761] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[nagachika00]

Issue #11444 has been updated by Tomoyuki Chikanaga.

Backport changed from 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: REQUIRED to 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: DONE

Backported r51594 into `ruby_2_2` branch at r52804.

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-55171

* Author: Andrew Cantino
* Status: Closed
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: DONE
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/

[ruby-core:71776] [Ruby trunk - Bug #11444] STDIN.each_codepoint hangs indefinitely on certain codepoints

[usa]

Issue #11444 has been updated by Usaku NAKAMURA.

Backport changed from 2.0.0: REQUIRED, 2.1: REQUIRED, 2.2: DONE to 2.0.0: REQUIRED, 2.1: DONE, 2.2: DONE

ruby_2_1 r52831 merged revision(s) 51583,51594,51638.

----------------------------------------
Bug #11444: STDIN.each_codepoint hangs indefinitely on certain codepoints
https://bugs.ruby-lang.org/issues/11444#change-55185

* Author: Andrew Cantino
* Status: Closed
* Priority: Normal
* Assignee: 
* ruby -v: ruby 2.3.0dev (2015-08-13 trunk 51569) [x86_64-linux]
* Backport: 2.0.0: REQUIRED, 2.1: DONE, 2.2: DONE
----------------------------------------
Piping certain Unicode data into Ruby and calling `each_codepoint` on `STDIN` results in a hang.  Control-c does not exit, but control-z will.  I've tested this in 2.2.0, 2.2.2, and trunk.

Please see https://gist.github.com/cantino/48f977bee6a39e33f80f for reproduction.  There is an example file with various Unicode Emoji characters in it (borrowed from http://apps.timwhitlock.info/emoji/tables/unicode).

I'd like to help fix this if anyone can point me in the right direction.  I fiddled with the file until I found a state where it works if one character is removed from the front of the file, so hopefully that's useful information.



-- 
https://bugs.ruby-lang.org/