From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00,
	DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no
	autolearn=ham autolearn_force=no version=3.4.6
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id E9ACC1F44D;
	Sun,  7 Apr 2024 09:29:04 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org;
	s=selector1; t=1712482145;
	bh=AsBc7Pt7dlwKYTS951ZJLyL+In8nbkow2SQuSqyU+C0=;
	h=Date:From:To:Cc:Subject:From;
	b=w2YoHNf5pd4busozab96cVUvJ7/+1tRIp5gBYCNwL2yPazZV9BcMba3Qp9SIQ6wTY
	 xKTOmPKAo8SEd+Bkocx8H5hPx7b2Me0rahfM2FPJZLsGkUcXjaeMGRbgt1r9y7xL2G
	 LlBlRW8CmIwxkMG78z4pk4arzXsnF1ishR5W6c2Q=
Date: Sun, 7 Apr 2024 09:29:04 +0000
From: Eric Wong <e@80x24.org>
To: git@vger.kernel.org
Cc: meta@public-inbox.org
Subject: public-inbox.org/git/*/s/ endpoints struggling
Message-ID: <20240407092904.M799327@dcvr>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
List-Id: <meta.public-inbox.org>

The blob reconstruction endpoints (aka the WWW version of `lei
blob') have been hammered by bots while I'm gathering data to
reproduce (and hopefully fix) fragmentation problems in
dlmalloc-based allocators.  The data gathering is silly
expensive all around and I'm on old and slow hardware and
intentionally ramped up bot traffic to gather more data.  I've
tweaked robots.txt for now, but it will take some time to take
effect and I'm also distracted with offline crap.

AFAIK, nobody else is running instances with blob reconstruction
enabled, yet (the feature has existed since 2019).  It's a
PITA to configure but I've been doing extensive work to make it
easier to configure and use.