* [PATCH 1/4] http: always yield on getline/body
2016-06-25 0:45 5% [PATCH 0/4] http + mbox: tiny optimizations Eric Wong
@ 2016-06-25 0:45 7% ` Eric Wong
0 siblings, 0 replies; 2+ results
From: Eric Wong @ 2016-06-25 0:45 UTC (permalink / raw)
To: meta
We want to maximize fairness for large responses which may
download the entire mbox.
---
lib/PublicInbox/HTTP.pm | 9 ++-------
1 file changed, 2 insertions(+), 7 deletions(-)
diff --git a/lib/PublicInbox/HTTP.pm b/lib/PublicInbox/HTTP.pm
index 800b240..c141fc8 100644
--- a/lib/PublicInbox/HTTP.pm
+++ b/lib/PublicInbox/HTTP.pm
@@ -16,7 +16,6 @@ use Fcntl qw(:seek);
use Plack::HTTPParser qw(parse_http_request); # XS or pure Perl
use HTTP::Status qw(status_message);
use HTTP::Date qw(time2str);
-use Time::HiRes qw(clock_gettime CLOCK_MONOTONIC);
use Scalar::Util qw(weaken);
use IO::File;
use constant {
@@ -26,8 +25,6 @@ use constant {
CHUNK_MAX_HDR => 256,
};
-sub now () { clock_gettime(CLOCK_MONOTONIC) }
-
# FIXME: duplicated code with NNTP.pm, layering violation
my $WEAKEN = {}; # string(inbox) -> inbox
my $weakt;
@@ -270,17 +267,15 @@ sub getline_response {
my $forward = $self->{forward};
# limit our own running time for fairness with other
# clients and to avoid buffering too much:
- my $end = now() + 0.1;
while ($forward && defined(my $buf = $forward->getline)) {
$write->($buf);
last if $self->{closed};
if ($self->{write_buf_size}) {
$self->write($self->{pull});
- return;
- } elsif (now() > $end) {
+ } else {
PublicInbox::EvCleanup::asap($self->{pull});
- return;
}
+ return;
}
$self->{forward} = $self->{pull} = undef;
$forward->close if $forward; # avoid recursion
^ permalink raw reply related [relevance 7%]
* [PATCH 0/4] http + mbox: tiny optimizations
@ 2016-06-25 0:45 5% Eric Wong
2016-06-25 0:45 7% ` [PATCH 1/4] http: always yield on getline/body Eric Wong
0 siblings, 1 reply; 2+ results
From: Eric Wong @ 2016-06-25 0:45 UTC (permalink / raw)
To: meta
For the gigantic $INBOX/all.mbox.gz response, this seems to slightly
improve speeds from roughly 290K/s to roughly 330K/s when fetching
out of a ~750MB aggressively-packed inbox.
Eric Wong (4):
http: always yield on getline/body
evcleanup: micro-optimize asap function
mbox: reduce small packets for gzipped mboxes
http: cork chunked responses for small savings
lib/PublicInbox/EvCleanup.pm | 42 +++++++++++++++++++++++++++++++++---------
lib/PublicInbox/HTTP.pm | 14 ++++++--------
lib/PublicInbox/Mbox.pm | 23 ++++++++++-------------
3 files changed, 49 insertions(+), 30 deletions(-)
^ permalink raw reply [relevance 5%]
Results 1-2 of 2 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2016-06-25 0:45 5% [PATCH 0/4] http + mbox: tiny optimizations Eric Wong
2016-06-25 0:45 7% ` [PATCH 1/4] http: always yield on getline/body Eric Wong
Code repositories for project(s) associated with this public inbox
https://80x24.org/public-inbox.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).