ruby-core@ruby-lang.org archive (unofficial mirror)
 help / color / mirror / Atom feed
* [ruby-core:54615] [ruby-trunk - Bug #8337][Open] Test failure and memory leak with OpenSSL::BN
@ 2013-04-27  6:29 h.shirosaki (Hiroshi Shirosaki)
  2013-04-27  8:23 ` [ruby-core:54616] [ruby-trunk - Bug #8337] " naruse (Yui NARUSE)
                   ` (4 more replies)
  0 siblings, 5 replies; 6+ messages in thread
From: h.shirosaki (Hiroshi Shirosaki) @ 2013-04-27  6:29 UTC (permalink / raw
  To: ruby-core


Issue #8337 has been reported by h.shirosaki (Hiroshi Shirosaki).

----------------------------------------
Bug #8337: Test failure and memory leak with OpenSSL::BN
https://bugs.ruby-lang.org/issues/8337

Author: h.shirosaki (Hiroshi Shirosaki)
Status: Open
Priority: Normal
Assignee: 
Category: ext
Target version: current: 2.1.0
ruby -v: ruby 2.1.0dev (2013-04-27 trunk 40468) [x86_64-darwin12.3.0]
Backport: 1.9.3: UNKNOWN, 2.0.0: UNKNOWN


I noticed test failure of test_to_bn.

http://ci.rubyinstaller.org/job/ruby-trunk-x64-test-all/1137/console
  1) Failure:
test_to_bn(OpenSSL::TestBN) [C:/Users/Worker/Jenkins/workspace/ruby-trunk-x64-build/test/openssl/test_bn.rb:36]:
<#<OpenSSL::BN:0x00000017d20188>> expected but was
<#<OpenSSL::BN:0x00000017d18460>>.

sizeof(VALUE) of the following code looks wrong because sizeof(VALUE) > sizeof(long) on x64 Windows.

https://github.com/ruby/ruby/blob/8b29525dadeaba1ba6dc2a9ea5e590aa9d1d825a/ext/openssl/ossl_bn.c#L130

And ALLOC_N() may need xfree().
I've confirmed memory leak with the following script.

$ ruby -rOpenSSL -e 'loop { 1.to_bn }'


Here is a patch to fix above issues.

diff --git a/ext/openssl/ossl_bn.c b/ext/openssl/ossl_bn.c
index 4e9734e..3d8e095 100644
--- a/ext/openssl/ossl_bn.c
+++ b/ext/openssl/ossl_bn.c
@@ -127,15 +127,17 @@ ossl_bn_initialize(int argc, VALUE *argv, VALUE self)
 	long n = FIX2LONG(str);
 	unsigned long un = labs(n);
 
-	for (i = sizeof(VALUE) - 1; 0 <= i; i--) {
+	for (i = sizeof(long) - 1; 0 <= i; i--) {
 	    bin[i] = un&0xff;
 	    un >>= 8;
 	}
 
 	GetBN(self, bn);
 	if (!BN_bin2bn(bin, sizeof(long), bn)) {
+	    xfree(bin);
 	    ossl_raise(eBNError, NULL);
 	}
+	xfree(bin);
 	if (n < 0) BN_set_negative(bn, 1);
 	return self;
     }
@@ -154,8 +156,10 @@ ossl_bn_initialize(int argc, VALUE *argv, VALUE self)
 
 	GetBN(self, bn);
 	if (!BN_bin2bn(bin, (int)sizeof(BDIGIT)*RBIGNUM_LENINT(str), bn)) {
+	    xfree(bin);
 	    ossl_raise(eBNError, NULL);
 	}
+	xfree(bin);
 	if (!RBIGNUM_SIGN(str)) BN_set_negative(bn, 1);
 	return self;
     }



-- 
http://bugs.ruby-lang.org/

^ permalink raw reply related	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2013-04-28 22:27 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2013-04-27  6:29 [ruby-core:54615] [ruby-trunk - Bug #8337][Open] Test failure and memory leak with OpenSSL::BN h.shirosaki (Hiroshi Shirosaki)
2013-04-27  8:23 ` [ruby-core:54616] [ruby-trunk - Bug #8337] " naruse (Yui NARUSE)
2013-04-27  8:24 ` [ruby-core:54617] " naruse (Yui NARUSE)
2013-04-28 15:28 ` [ruby-core:54667] [ruby-trunk - Bug #8337][Assigned] " nagachika (Tomoyuki Chikanaga)
2013-04-28 16:11 ` [ruby-core:54670] [ruby-trunk - Bug #8337][Closed] " h.shirosaki (Hiroshi Shirosaki)
2013-04-28 22:03 ` [ruby-core:54677] [ruby-trunk - Bug #8337] " nagachika (Tomoyuki Chikanaga)

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).