Re: [PATCH v4 4/4] Add generic C.UTF-8 locale (Bug 17318)

[Florian Weimer via Libc-alpha <libc-alpha@sourceware.org>]

* Carlos O'Donell:

> We add a new C.UTF-8 locale.  This locale is not builtin to glibc, but
> is provided as a distinct locale.  The locale provides full support
> for UTF-8 and this includes full code point sorting via collation
> (excludes surrogates).  Unfortuantely given the present implementation
> in glibc this results in 28MiB of LC_COLLATE data for all possible
> Unicode code points.  Future improvements may reduce this size. Such
> improvements likely require a shortcut for the collation data that
> relies on C.UTF-8 single-byte sorting being equivalent to strcmp.
>
> The new locale is NOT added to SUPPORTED.  Minimal test data for
> specific code points (minus those not supported by collate-test) is
> provided in C.UTF-8.in, and this verifies code point sorting is
> working reasonably across the range.
>
> The next step is to reduce LC_COLLATE to a manageable size before we
> enable the locale in SUPPORTED. Fully testing C.UTF-8 collation can
> add ~5-7 minutes to the locale testing (collate-test, and xfrm-test
> twice) so we don't enable full testing of all code points until we can
> parallelize the sort-test test. Testing sort-test with C.UTF-8 minimal
> test data passes cleanly.

Can you compare this locale with what is in Fedora and Debian, for the
non-collaction/CTYPE aspects?

Are there other distributions which ship a downstream C.UTF-8 locale?

Thanks,
Florian