From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 4A0F31F461 for ; Sat, 29 Jun 2019 19:59:51 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 00/11] ds: more updates Date: Sat, 29 Jun 2019 19:59:40 +0000 Message-Id: <20190629195951.32160-1-e@80x24.org> List-Id: We can simplify a lot of our async logic now that we don't have to deal with the buffer-to-heap behavior of Danga::Socket. The biggest change is now we no longer tie git-http-backend(1) runtime and memory use to the bandwidth of a slow HTTP client. This increases buffering on the FS (which may be tmpfs or a fast SSD); but it's what nginx (and varnish) would be doing, anyways We can further remove a lot of the EvCleanup code since that was to workaround deferred close being deferred for too long when no I/O events were firing. HTTPS now works, but more work needs to be done because Varnish is still a requirement for busy sites. Eric Wong (11): ds: share lazy rbuf handling between HTTP and NNTP ds: move requeue logic over from NNTP http: use requeue instead of watch_in1 listener: use edge-triggered notifications ds: handle deferred DS->close after timers ds: consolidate IO::Socket::SSL checks http: support HTTPS (kinda) parentpipe: document and use one-shot wakeups parentpipe: make the ->close call more obvious httpd/async: switch to buffering-as-fast-as-possible http: use bigger, but shorter-lived buffers for pipes MANIFEST | 1 + lib/PublicInbox/DS.pm | 85 +++++++++++++++---------- lib/PublicInbox/DSKQXS.pm | 4 +- lib/PublicInbox/Daemon.pm | 4 +- lib/PublicInbox/EvCleanup.pm | 80 +++-------------------- lib/PublicInbox/HTTP.pm | 102 +++++++++++++++-------------- lib/PublicInbox/HTTPD/Async.pm | 55 ++++++++-------- lib/PublicInbox/Listener.pm | 7 +- lib/PublicInbox/NNTP.pm | 47 +++----------- lib/PublicInbox/ParentPipe.pm | 17 +++-- lib/PublicInbox/Qspawn.pm | 2 +- lib/PublicInbox/Syscall.pm | 4 +- lib/PublicInbox/TLS.pm | 9 +-- t/httpd-https.t | 141 +++++++++++++++++++++++++++++++++++++++++ 14 files changed, 314 insertions(+), 244 deletions(-) create mode 100644 t/httpd-https.t -- EW