From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <julm+public-inbox@sourcephile.fr>
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-Status: No, score=-3.2 required=3.0 tests=BAYES_00,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS
	shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2
Received: from mermet.sourcephile.fr (revolt129.abo.ilico.org [80.67.180.129])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(No client certificate requested)
	by dcvr.yhbt.net (Postfix) with ESMTPS id 5E2441F55B
	for <meta@public-inbox.org>; Thu, 28 May 2020 15:12:20 +0000 (UTC)
Date: Thu, 28 May 2020 17:12:16 +0200
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourcephile.fr;
	s=20200101; t=1590678736;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding;
	bh=S160c9ZuSs4+4F8Ls7t04MK0HRECS0z6xHgLFBkvtRA=;
	b=62KhUpS7R8pOkO9HGWm4rzvLmFOWobiSRHjauky5JDE1qjy+XNL8OU2/VswGJjPdQ9timK
	5+7VFRQ2zTP99P2LpMnqZlOlklT7b6+FXfMm2wWsLj+nIG/Qpfuzkn2/gTjRM5hWg/UYRs
	rJmSNhV3jqi6x98f/jqmCjmg2ejTx0JBLiJiwfSPavdY1ORP0nk+l0WubC2z2YWAwPp8BP
	GxKAULeh/6eCHWiwuS3bwnMlDU8DwalqRvSbPcjjxqmHto9Ni+gkk4EXEJPK2zY8G6J6q3
	HOMkruy0+cLDsjCWVS13LQ48ykuGfpEMwjArhdYQxsJUxmnlKJzvn0QOuBLIHhUPng431m
	W0A4zVDKN5yAMD1c4caN09MtEHsBZbU+Qlix/21c9X2wX8m1DYZ2uBDeoJWMdH7SJmass3
	yJ0ipx8+D6WJuHt1WHIAIQgklLM+cXoteMhwYFSYf525QSiPT5rttB4zPD7Kf/uGPRTYw8
	UD2d+TIDj4vPBHxroFHitMMkp5iPOm5YNX6pmgz0IrW1JztLhY8Q8uYbZ2NNkO0j54r7qJ
	EPGgfEV6jcp1q8quJBFFcZ0KipoWkW5JPDvGmiq0/r+Qg7U0YutjhUMH1hLCP8+56y8vMV
	0EEwdRFgYuZloiy3I+nqUsVejHWHCr01NFzEFTCZ54w9Fa2GpVlUI=
From: Julien Moutinho <julm+public-inbox@sourcephile.fr>
To: meta@public-inbox.org
Subject: bug: httpd: incorrect Unicode output of $INBOX_DIR/description
Message-ID: <20200528151216.l7vmnmrs4ojw372g@sourcephile.fr>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
List-Id: <meta.public-inbox.org>

Description
-----------
public-inbox-httpd does not output $INBOX_DIR/description
using the expected Unicode code points.

Reproducing
-----------
$ cat /var/lib/public-inbox/inboxes/equipage/description
=C3=89quipage

$ file $(readlink -e description)
/nix/store/a7m2gqmj417dlqzjq1arizm7gxxrdqqm-description: UTF-8 Unicode text=
, with no line terminators

Is rendered by public-inbox-httpd as:
$ curl -s http://example.org/lists/archives/ | grep quipage'$'
&#195;&#137;quipage

My setup: public-inbox-1.5.0, or public-inbox-1.2.0, on NixOS.

Expecting
---------
$ curl -s http://example.org/lists/archives/ | grep quipage'$'
=C3=8Aquipage

Or:
$ curl -s http://example.org/lists/archives/ | grep quipage'$'
&#201;quipage

Debugging
---------
This may be due to using: ascii_html($ibx->description);

Thanks a lot for developing public-inbox,
Julien.