From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS4713 221.184.0.0/13 X-Spam-Status: No, score=-3.5 required=3.0 tests=AWL,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RCVD_IN_DNSWL_MED,SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.1 Received: from neon.ruby-lang.org (neon.ruby-lang.org [221.186.184.75]) by dcvr.yhbt.net (Postfix) with ESMTP id 03319208EB for ; Tue, 7 Aug 2018 02:44:16 +0000 (UTC) Received: from neon.ruby-lang.org (localhost [IPv6:::1]) by neon.ruby-lang.org (Postfix) with ESMTP id CF2C3120B68; Tue, 7 Aug 2018 11:44:12 +0900 (JST) Received: from o1678948x4.outbound-mail.sendgrid.net (o1678948x4.outbound-mail.sendgrid.net [167.89.48.4]) by neon.ruby-lang.org (Postfix) with ESMTPS id 42513120B5F for ; Tue, 7 Aug 2018 11:44:11 +0900 (JST) Received: by filter0058p3las1.sendgrid.net with SMTP id filter0058p3las1-26894-5B690777-28 2018-08-07 02:44:07.947145172 +0000 UTC m=+540830.404979292 Received: from herokuapp.com (ec2-54-158-232-0.compute-1.amazonaws.com [54.158.232.0]) by ismtpd0038p1mdw1.sendgrid.net (SG) with ESMTP id 0btEkIenTMep2ekHM2zjpQ Tue, 07 Aug 2018 02:44:08.197 +0000 (UTC) Date: Tue, 07 Aug 2018 02:44:08 +0000 (UTC) From: Greg.mpls@gmail.com To: ruby-core@ruby-lang.org Message-ID: References: Mime-Version: 1.0 X-Redmine-MailingListIntegration-Message-Ids: 63701 X-Redmine-Project: ruby-trunk X-Redmine-Issue-Id: 14968 X-Redmine-Issue-Author: normalperson X-Redmine-Sender: MSP-Greg X-Mailer: Redmine X-Redmine-Host: bugs.ruby-lang.org X-Redmine-Site: Ruby Issue Tracking System X-Auto-Response-Suppress: All Auto-Submitted: auto-generated X-SG-EID: ync6xU2WACa70kv/Ymy4QrNMhiuLXJG8OTL2vJD1yS7UlFAaxgYf5nOLGOVCNylRVSEuzhUxKLL1tK k47l09rrk0/9ECC6RV8mE+AmG1d8q8q6NGmD6bGgSD0hzWobbHtUXsufx4lh7cP9HV0QqNfzdWmgyn 4kEn3nFVkjci2wtUZa3NBQfugi73iZ1rj8vOXDamn1ipas9qvJRuBHZUwQ== X-ML-Name: ruby-core X-Mail-Count: 88319 Subject: [ruby-core:88319] [Ruby trunk Bug#14968] [PATCH] io.c: make all pipes nonblocking by default X-BeenThere: ruby-core@ruby-lang.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: Ruby developers List-Id: Ruby developers List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ruby-core-bounces@ruby-lang.org Sender: "ruby-core" Issue #14968 has been updated by MSP-Greg (Greg L). @normalperson Eric, The zip of all the logs is at https://ci.appveyor.com/api/buildjobs/pwyhyvkao2nssxy1/artifacts/zlogs_trunk_2018-08-07_64208.7z All of the test-all failures show something similar to: ``` [Errno::ENOENT] exception expected, not. Class: ``` The test-spec failures are similar. Test summary below: ``` 13 Total Failures/Errors Build No 1032 Job Id pwyhyvkao2nssxy1 ruby 2.6.0dev (2018-08-07 trunk 64208) [x64-mingw32] 2018-08-07 02:29:51 UTC test-all 19301 tests, 2250081 assertions, 5 failures, 0 errors, 107 skips, 107 skips shown test-spec 3690 files, 28734 examples, 210530 expectations, 2 failures, 4 errors, 0 tagged mspec 3690 files, 28736 examples, 210420 expectations, 2 failures, 4 errors, 0 tagged test-basic test succeeded btest PASS all 1392 tests ``` ---------------------------------------- Bug #14968: [PATCH] io.c: make all pipes nonblocking by default https://bugs.ruby-lang.org/issues/14968#change-73350 * Author: normalperson (Eric Wong) * Status: Open * Priority: Normal * Assignee: * Target version: * ruby -v: * Backport: 2.3: UNKNOWN, 2.4: UNKNOWN, 2.5: UNKNOWN ---------------------------------------- Crap, I always planned to have something like this for [Feature #13618] (auto-Fiber); but introducing a race condition for Timer-thread elimination in [Misc #14937] forced me to introduce this early. Anyways, I might have to revert and reintroduce timer-thread if this change is unnacceptable :< (I HATE timer thread) ``` io.c: make all pipes nonblocking by default All normal Ruby IO methods (IO#read, IO#gets, IO#write, ...) are all capable of appearing to be "blocking" when presented with a file description with the O_NONBLOCK flag set; so there is little risk of incompatibility within Ruby-using programs. The biggest compatibility risk is when spawning external programs. As a result, stdin, stdout, and stderr are now always made blocking before exec-family calls. Timer-thread elimination in https://bugs.ruby-lang.org/issues/14937 introduced a race condition in signal handling. It is possible to receive a signal inside BLOCKING_REGION right before read/write syscalls. If this patch cannot be accepted, I will have to revert to reintroduce timer-thread and increase resource use (which led to other failures in the past). The race condition introduced for [Misc #14937] led to rare CI failures on a few tests: - test/ruby/test_thread.rb (test_thread_timer_and_interrupt): http://www.rubyist.net/~akr/chkbuild/debian/ruby-trunk/log/20180805T080500Z.fail.html.gz - test/ruby/test_io.rb (test_race_gets_and_close): http://ci.rvm.jp/results/trunk@P895/1190369 This change is ALSO necessary to take advantage of (proposed lightweight concurrency (aka "auto-Fiber") or any similar proposal: https://bugs.ruby-lang.org/issues/13618 TODO: all sockets and FIFOs non-blocking by default, too ``` ---Files-------------------------------- 0001-io.c-make-all-pipes-nonblocking-by-default.patch (12.1 KB) -- https://bugs.ruby-lang.org/