Re: [PATCH] listener: don't set listen backlog on inherited sockets

[Konstantin Ryabitsev <konstantin@linuxfoundation.org>]

On Wed, Mar 05, 2025 at 12:45:36AM +0000, Eric Wong wrote:
> Eric Wong <e@80x24.org> wrote:
> > I wonder if prioritizing certain User-Agents (e.g. curl, w3m,
> > anything with non-Anroid "Linux" in it) would be a quick fix in
> > haproxy||nginx.
> 
> This seems like a long overdue change to allow certain listen
> sockets to handle more traffic than others.

That's a neat trick, but not quite what I was looking for. It's not that we're
not able to handle the number of connections -- public-inbox-httpd is actually
really good at it. In fact, when I migrated things to EL9, I managed to mess
up my configuration and ran lore for a few months without -W8, and even then
everything mostly worked amazingly well. :)

However, we do generate a lot of traffic and unnecessary cpu churn just to
train someone's LLM. I don't care about the training part (well, I do, but I
can't do anything about it), but doing it over the web when they can just
clone the underlying repositories is the stupidest way to do it.

So, when musing about the gemini view, I was really just thinking of ways to
reduce the dumb AI bots while still giving unrestricted access to anyone else
with a gemini client.

That said, I will play with this change, as this will for sure let me
prioritize b4/curl traffic over anything that identifies itself as a browser.

Thanks!

-K