diff options
| author | Carlos O'Donell <carlos@redhat.com> | 2021-09-01 15:19:19 -0400 |
|---|---|---|
| committer | Carlos O'Donell <carlos@redhat.com> | 2021-09-06 11:30:28 -0400 |
| commit | 466f2be6c08070e9113ae2fdc7acd5d8828cba50 (patch) | |
| tree | c4fb7c10d98994298dcd451df71f1be790b575e9 /NEWS | |
| parent | f5117c6504888fab5423282a4607c552b90fd3f9 (diff) | |
| download | glibc-466f2be6c08070e9113ae2fdc7acd5d8828cba50.tar.gz glibc-466f2be6c08070e9113ae2fdc7acd5d8828cba50.tar.xz glibc-466f2be6c08070e9113ae2fdc7acd5d8828cba50.zip | |
Add generic C.UTF-8 locale (Bug 17318)
We add a new C.UTF-8 locale. This locale is not builtin to glibc, but is provided as a distinct locale. The locale provides full support for UTF-8 and this includes full code point sorting via STRCMP-based collation (strcmp or wcscmp). The collation uses a new keyword 'codepoint_collation' which drops all collation rules and generates an empty zero rules collation to enable STRCMP usage in collation. This ensures that we get full code point sorting for C.UTF-8 with a minimal 1406 bytes of overhead (LC_COLLATE structure information and ASCII collating tables). The new locale is added to SUPPORTED. Minimal test data for specific code points (minus those not supported by collate-test) is provided in C.UTF-8.in, and this verifies code point sorting is working reasonably across the range. The locale was tested manually with the full set of code points without failure. The locale is harmonized with locales already shipping in various downstream distributions. A new tst-iconv9 test is added which verifies the C.UTF-8 locale is generally usable. Testing for fnmatch, regexec, and recomp is provided by extending bug-regex1, bugregex19, bug-regex4, bug-regex6, transbug, tst-fnmatch, tst-regcomp-truncated, and tst-regex to use C.UTF-8. Tested on x86_64 or i686 without regression. Reviewed-by: Florian Weimer <fweimer@redhat.com>
Diffstat (limited to 'NEWS')
| -rw-r--r-- | NEWS | 10 |
1 files changed, 9 insertions, 1 deletions
diff --git a/NEWS b/NEWS index 79c895e382..5b014fabbf 100644 --- a/NEWS +++ b/NEWS @@ -9,7 +9,15 @@ Version 2.35 Major new features: - [Add new features here] +* Support for the C.UTF-8 locale has been added to glibc. The locale + supports full code-point sorting for all valid Unicode code points. A + limitation in the framework for fnmatch, regexec, and regcomp requires + a compromise to save space and only ASCII-based range expressions are + supported for now (see bug 28255). The full size of the locale is + only ~400KiB, with 346KiB coming from LC_CTYPE information for + Unicode. This locale harmonizes downstream C.UTF-8 already shipping + in various downstream distributions. The locale is not built into + glibc, and must be installed. Deprecated and removed features, and other changes affecting compatibility: |