From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS17314 8.43.84.0/22 X-Spam-Status: No, score=-4.3 required=3.0 tests=AWL,BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_HI,SPF_HELO_PASS,SPF_PASS shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from sourceware.org (server2.sourceware.org [8.43.85.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id 3503F1F5AE for ; Fri, 30 Apr 2021 18:20:17 +0000 (UTC) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 4F652385043D; Fri, 30 Apr 2021 18:20:16 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 4F652385043D DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1619806816; bh=rAJ976F5wH0w2C2fk6EUAOzjIJJImUGnI50OVCKMpAY=; h=To:Subject:References:Date:In-Reply-To:List-Id:List-Unsubscribe: List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:Cc: From; b=xCgz/v3CNUvLgso6Vh1k+XVGdRJyKup4UvPxwaHqoMntsPn/MY6avp2Tczwht8WDA iQsLEJK1/EORTbtg3XdmUK3X3/jTviNp5S2YejKhkJHHzMNMoYpmfBxDlBQmnvcNCC D9+wD8QOmqEsDPvrX4+aapQiuKvzWK1SZfw8jkjg= Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by sourceware.org (Postfix) with ESMTP id 7BF98385803C for ; Fri, 30 Apr 2021 18:20:13 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 7BF98385803C Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-44-2zw-sac3M_uELHPNrESaHw-1; Fri, 30 Apr 2021 14:20:10 -0400 X-MC-Unique: 2zw-sac3M_uELHPNrESaHw-1 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 7BC18107ACC7 for ; Fri, 30 Apr 2021 18:20:09 +0000 (UTC) Received: from oldenburg.str.redhat.com (ovpn-115-124.ams2.redhat.com [10.36.115.124]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 72E915C232; Fri, 30 Apr 2021 18:20:04 +0000 (UTC) To: Carlos O'Donell Subject: Re: [PATCH v4 4/4] Add generic C.UTF-8 locale (Bug 17318) References: <20210428130033.3196848-1-carlos@redhat.com> <20210428130033.3196848-5-carlos@redhat.com> <87eeetfaan.fsf@oldenburg.str.redhat.com> <93ab3888-25db-4582-ce6a-c7a91ac14417@redhat.com> Date: Fri, 30 Apr 2021 20:20:17 +0200 In-Reply-To: (Carlos O'Donell's message of "Fri, 30 Apr 2021 13:59:49 -0400") Message-ID: <87a6pf4ota.fsf@oldenburg.str.redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Florian Weimer via Libc-alpha Reply-To: Florian Weimer Cc: libc-alpha@sourceware.org Errors-To: libc-alpha-bounces@sourceware.org Sender: "Libc-alpha" * Carlos O'Donell: > On 4/29/21 4:05 PM, Carlos O'Donell wrote: >> - LC_CTYPE, includes "translit_combining" which is wrong for a C locale IMO. >> - Upstream C.UTF-8 includes no transliteration, all characters pass >> through because UTF-8 supports all such characters. > > It turns out that this is related to bug 26984. > > I was wrong too, the C locale has a builtin set of ~1600 transliterations that > it uses internally (I even reviewed a patch for that you committed). > I had completely forgotten about this internal detail. > > This transliteration affects converters ability to use //TRANSLIT, and so I > think we should include all the netural transliterations e.g. > > translit_start > include "translit_neutral";"" > translit_end > > This makes things *better* with respect to harmonization with Debian/Ubuntu. > > Thoughts? > > In summary: > - POSIX says nothing about transliteration. > - C/POSIX already includes a partial set of ~1600 translit entries, and they > are largely incomplete. It would be nice to harmonize them with the proper > translit_neutral set. > - C.UTF-8 including translit_neutral would bring in ~25,000 translit rules > for conversions from UTF-8 to other charmaps. This would be a superset of > those offered by C/POSIX. > - Fixing C/POSIX is another issue. I'm in favor of including those transliterations. Thanks, Florian