ruby-core@ruby-lang.org archive (unofficial mirror)
 help / color / mirror / Atom feed
From: dennisb55@hotmail.com
To: ruby-core@ruby-lang.org
Subject: [ruby-core:92046] [Ruby trunk Feature#15667] Introduce malloc_trim(0) in full gc cycles
Date: Fri, 29 Mar 2019 04:30:51 +0000 (UTC)	[thread overview]
Message-ID: <redmine.journal-77367.20190329043051.4da02cec4ee73c46@ruby-lang.org> (raw)
In-Reply-To: redmine.issue-15667.20190314203432@ruby-lang.org

Issue #15667 has been updated by bluz71 (Dennis B).


Thanks Sam, a very nice set of results.

Notice that 99th percentile Topic list was faster with the patch, whilst slower with Topic view. So I'm not sure we can say that the patch will always be slower on the worst runs.

Query, what is the version of jemalloc that you are using? One of the interesting observations in [#14759](https://bugs.ruby-lang.org/issues/14759#note-6) is the variance between jemalloc versions (say 3.6.0 vs 5.1.0).

----------------------------------------
Feature #15667: Introduce malloc_trim(0) in full gc cycles
https://bugs.ruby-lang.org/issues/15667#change-77367

* Author: sam.saffron (Sam Saffron)
* Status: Open
* Priority: Normal
* Assignee: 
* Target version: 
----------------------------------------
Per Hongli's excellent article it looks like malloc_trim can help tremendously with memory bloat issues. 


https://www.joyfulbikeshedding.com/blog/2019-03-14-what-causes-ruby-memory-bloat.html#a-magic-trick-trimming


I would like to get this patch tested side-by-side at Discourse, GitHub and Shopify. If it looks good I think this is both a great candidate for 2.7 and and 2.4,2.5,2.6 backports. 


Will coordinate with Shopify and GitHub to see if we can get numbers posted here, I will run tests on a live Discourse instance over the next week and report numbers here. 

Koichi, what are your thoughts, to me this looks like an incredibly safe patch, the amount of work added to major GCs is tiny compared to the potential benefit, walking all pages is a very cheap operation.



---Files--------------------------------
ruby_gc_malloc_trim.patch (1011 Bytes)
Screenshot_2019-03-28 Grafana - Compare Discourse Perf.png (530 KB)


-- 
https://bugs.ruby-lang.org/

  parent reply	other threads:[~2019-03-29  4:31 UTC|newest]

Thread overview: 12+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <redmine.issue-15667.20190314203432@ruby-lang.org>
2019-03-14 20:34 ` [ruby-core:91837] [Ruby trunk Feature#15667] Introduce malloc_trim(0) in full gc cycles sam.saffron
2019-03-17 23:15   ` [ruby-core:91858] " Eric Wong
2019-03-14 23:50 ` [ruby-core:91841] " sam.saffron
2019-03-20  1:40 ` [ruby-core:91889] " mame
2019-03-25  0:52 ` [ruby-core:91968] " sam.saffron
2019-03-28  1:52 ` [ruby-core:92027] " sam.saffron
2019-03-29  4:30 ` dennisb55 [this message]
2019-03-31  1:52 ` [ruby-core:92060] " philipp
2019-04-01  4:05 ` [ruby-core:92070] " sam.saffron
2019-04-01  9:28   ` [ruby-core:92087] " Waheed Al-Barghouthi
2019-04-01  9:53     ` [ruby-core:92088] " Martin J. Dürst
2019-09-19  8:07 ` [ruby-core:94981] [Ruby master " dosadnizub

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-list from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://www.ruby-lang.org/en/community/mailing-lists/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=redmine.journal-77367.20190329043051.4da02cec4ee73c46@ruby-lang.org \
    --to=ruby-core@ruby-lang.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).