* new module 'c32snrtombs'
@ 2020-01-10 22:32 Bruno Haible
0 siblings, 0 replies; only message in thread
From: Bruno Haible @ 2020-01-10 22:32 UTC (permalink / raw)
To: bug-gnulib
[-- Attachment #1: Type: text/plain, Size: 1235 bytes --]
The function c32snrtombs is like wcsnrtombs, except that it takes a char32_t[]
string as argument instead of a wchar_t[] string.
2020-01-10 Bruno Haible <bruno@clisp.org>
c32snrtombs: Add tests.
* tests/test-c32snrtombs.c: New file, based on tests/test-wcsnrtombs.c.
* tests/test-c32snrtombs-1.sh: New file, based on
tests/test-wcsnrtombs1.sh.
* tests/test-c32snrtombs-2.sh: New file, based on
tests/test-wcsnrtombs2.sh.
* tests/test-c32snrtombs-3.sh: New file, based on
tests/test-wcsnrtombs3.sh.
* tests/test-c32snrtombs-4.sh: New file, based on
tests/test-wcsnrtombs4.sh.
* modules/c32snrtombs-tests: New file, based on
modules/wcsnrtombs-tests.
c32snrtombs: New module.
* lib/uchar.in.h (c32snrtombs): New declaration.
* lib/wcsnrtombs-impl.h: Parameterize: Use macros FUNC, SCHAR_T,
INTERNAL_STATE, WCRTOMB.
* lib/wcsnrtombs.c (FUNC, SCHAR_T, INTERNAL_STATE, WCRTOMB): New macros.
* lib/c32snrtombs.c: New file.
* m4/uchar.m4 (gl_UCHAR_H_DEFAULTS): Initialize GNULIB_C32SNRTOMBS.
* modules/uchar (Makefile.am): Substitute GNULIB_C32SNRTOMBS.
* modules/c32snrtombs: New file.
* tests/test-uchar-c++.cc: Test the signature of c32snrtombs.
* doc/posix-functions/wcsnrtombs.texi: Mention the new module.
[-- Attachment #2: 0001-c32snrtombs-New-module.patch --]
[-- Type: text/x-patch, Size: 10143 bytes --]
From 980b40b1d6464d3aa9e68d8a0c19009c6cdaf6fb Mon Sep 17 00:00:00 2001
From: Bruno Haible <bruno@clisp.org>
Date: Fri, 10 Jan 2020 23:28:47 +0100
Subject: [PATCH 1/2] c32snrtombs: New module.
* lib/uchar.in.h (c32snrtombs): New declaration.
* lib/wcsnrtombs-impl.h: Parameterize: Use macros FUNC, SCHAR_T,
INTERNAL_STATE, WCRTOMB.
* lib/wcsnrtombs.c (FUNC, SCHAR_T, INTERNAL_STATE, WCRTOMB): New macros.
* lib/c32snrtombs.c: New file.
* m4/uchar.m4 (gl_UCHAR_H_DEFAULTS): Initialize GNULIB_C32SNRTOMBS.
* modules/uchar (Makefile.am): Substitute GNULIB_C32SNRTOMBS.
* modules/c32snrtombs: New file.
* tests/test-uchar-c++.cc: Test the signature of c32snrtombs.
* doc/posix-functions/wcsnrtombs.texi: Mention the new module.
---
ChangeLog | 14 ++++++++++
doc/posix-functions/wcsnrtombs.texi | 7 +++--
lib/c32snrtombs.c | 56 +++++++++++++++++++++++++++++++++++++
lib/uchar.in.h | 13 +++++++++
lib/wcsnrtombs-impl.h | 14 +++++-----
lib/wcsnrtombs.c | 4 +++
m4/uchar.m4 | 3 +-
modules/c32snrtombs | 31 ++++++++++++++++++++
modules/uchar | 1 +
tests/test-uchar-c++.cc | 5 ++++
10 files changed, 138 insertions(+), 10 deletions(-)
create mode 100644 lib/c32snrtombs.c
create mode 100644 modules/c32snrtombs
diff --git a/ChangeLog b/ChangeLog
index 53a1fb4..84bc7d2 100644
--- a/ChangeLog
+++ b/ChangeLog
@@ -1,3 +1,17 @@
+2020-01-10 Bruno Haible <bruno@clisp.org>
+
+ c32snrtombs: New module.
+ * lib/uchar.in.h (c32snrtombs): New declaration.
+ * lib/wcsnrtombs-impl.h: Parameterize: Use macros FUNC, SCHAR_T,
+ INTERNAL_STATE, WCRTOMB.
+ * lib/wcsnrtombs.c (FUNC, SCHAR_T, INTERNAL_STATE, WCRTOMB): New macros.
+ * lib/c32snrtombs.c: New file.
+ * m4/uchar.m4 (gl_UCHAR_H_DEFAULTS): Initialize GNULIB_C32SNRTOMBS.
+ * modules/uchar (Makefile.am): Substitute GNULIB_C32SNRTOMBS.
+ * modules/c32snrtombs: New file.
+ * tests/test-uchar-c++.cc: Test the signature of c32snrtombs.
+ * doc/posix-functions/wcsnrtombs.texi: Mention the new module.
+
2020-01-09 Bruno Haible <bruno@clisp.org>
c32srtombs: Add tests.
diff --git a/doc/posix-functions/wcsnrtombs.texi b/doc/posix-functions/wcsnrtombs.texi
index 4cdfc7a..1b5fc12 100644
--- a/doc/posix-functions/wcsnrtombs.texi
+++ b/doc/posix-functions/wcsnrtombs.texi
@@ -24,6 +24,9 @@ Solaris 11 OpenIndiana.
Portability problems not fixed by Gnulib:
@itemize
@item
-On Windows and 32-bit AIX platforms, @code{wchar_t} is a 16-bit type and therefore cannot
-accommodate all Unicode characters.
+On Windows and 32-bit AIX platforms, @code{wchar_t} is a 16-bit type and
+therefore cannot accommodate all Unicode characters.
+However, the Gnulib function @code{c32snrtombs}, provided by Gnulib module
+@code{c32snrtombs}, operates on 32-bit wide characters and therefore does not
+have this limitation.
@end itemize
diff --git a/lib/c32snrtombs.c b/lib/c32snrtombs.c
new file mode 100644
index 0000000..bd47e30
--- /dev/null
+++ b/lib/c32snrtombs.c
@@ -0,0 +1,56 @@
+/* Convert 32-bit wide string to string.
+ Copyright (C) 2020 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation; either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <https://www.gnu.org/licenses/>. */
+
+/* Written by Bruno Haible <bruno@clisp.org>, 2020. */
+
+#include <config.h>
+
+/* Specification. */
+#include <uchar.h>
+
+#include <wchar.h>
+
+#if (HAVE_WORKING_MBRTOC32 && !defined __GLIBC__) || _GL_LARGE_CHAR32_T
+/* The char32_t encoding of a multibyte character may be different than its
+ wchar_t encoding, or char32_t is wider than wchar_t. */
+
+# include <errno.h>
+# include <stdlib.h>
+# include <string.h>
+
+extern mbstate_t _gl_c32srtombs_state;
+
+# define FUNC c32snrtombs
+# define SCHAR_T char32_t
+# define INTERNAL_STATE _gl_c32srtombs_state
+# define WCRTOMB c32rtomb
+# include "wcsnrtombs-impl.h"
+
+#else
+/* char32_t and wchar_t are equivalent. */
+
+# include "verify.h"
+
+verify (sizeof (char32_t) == sizeof (wchar_t));
+
+size_t
+c32snrtombs (char *dest, const char32_t **srcp, size_t srclen, size_t len,
+ mbstate_t *ps)
+{
+ return wcsnrtombs (dest, (const wchar_t **) srcp, srclen, len, ps);
+}
+
+#endif
diff --git a/lib/uchar.in.h b/lib/uchar.in.h
index 75da254..a149f5a 100644
--- a/lib/uchar.in.h
+++ b/lib/uchar.in.h
@@ -94,6 +94,19 @@ _GL_WARN_ON_USE (mbrtoc32, "c32rtomb is not portable - "
/* Convert a 32-bit wide string to a string. */
+#if @GNULIB_C32SNRTOMBS@
+_GL_FUNCDECL_SYS (c32snrtombs, size_t,
+ (char *dest, const char32_t **srcp, size_t srclen, size_t len,
+ mbstate_t *ps)
+ _GL_ARG_NONNULL ((2)));
+_GL_CXXALIAS_SYS (c32snrtombs, size_t,
+ (char *dest, const char32_t **srcp, size_t srclen, size_t len,
+ mbstate_t *ps));
+_GL_CXXALIASWARN (c32snrtombs);
+#endif
+
+
+/* Convert a 32-bit wide string to a string. */
#if @GNULIB_C32SRTOMBS@
_GL_FUNCDECL_SYS (c32srtombs, size_t,
(char *dest, const char32_t **srcp, size_t len, mbstate_t *ps)
diff --git a/lib/wcsnrtombs-impl.h b/lib/wcsnrtombs-impl.h
index b50c6c0..7af3b36 100644
--- a/lib/wcsnrtombs-impl.h
+++ b/lib/wcsnrtombs-impl.h
@@ -16,12 +16,12 @@
along with this program. If not, see <https://www.gnu.org/licenses/>. */
size_t
-wcsnrtombs (char *dest, const wchar_t **srcp, size_t srclen, size_t len, mbstate_t *ps)
+FUNC (char *dest, const SCHAR_T **srcp, size_t srclen, size_t len, mbstate_t *ps)
{
if (ps == NULL)
- ps = &_gl_wcsrtombs_state;
+ ps = &INTERNAL_STATE;
{
- const wchar_t *src = *srcp;
+ const SCHAR_T *src = *srcp;
size_t cur_max = MB_CUR_MAX;
char buf[64];
@@ -34,8 +34,8 @@ wcsnrtombs (char *dest, const wchar_t **srcp, size_t srclen, size_t len, mbstate
for (; srclen > 0 && len > 0; src++, srclen--)
{
- wchar_t wc = *src;
- size_t ret = wcrtomb (len >= cur_max ? destptr : buf, wc, ps);
+ SCHAR_T wc = *src;
+ size_t ret = WCRTOMB (len >= cur_max ? destptr : buf, wc, ps);
if (ret == (size_t)(-1))
goto bad_input;
@@ -66,8 +66,8 @@ wcsnrtombs (char *dest, const wchar_t **srcp, size_t srclen, size_t len, mbstate
for (; srclen > 0; src++, srclen--)
{
- wchar_t wc = *src;
- size_t ret = wcrtomb (buf, wc, &state);
+ SCHAR_T wc = *src;
+ size_t ret = WCRTOMB (buf, wc, &state);
if (ret == (size_t)(-1))
goto bad_input2;
diff --git a/lib/wcsnrtombs.c b/lib/wcsnrtombs.c
index 236bfc7..88be656 100644
--- a/lib/wcsnrtombs.c
+++ b/lib/wcsnrtombs.c
@@ -27,4 +27,8 @@
extern mbstate_t _gl_wcsrtombs_state;
+#define FUNC wcsnrtombs
+#define SCHAR_T wchar_t
+#define INTERNAL_STATE _gl_wcsrtombs_state
+#define WCRTOMB wcrtomb
#include "wcsnrtombs-impl.h"
diff --git a/m4/uchar.m4 b/m4/uchar.m4
index 4e9b16d..2a84bd1 100644
--- a/m4/uchar.m4
+++ b/m4/uchar.m4
@@ -1,4 +1,4 @@
-# uchar.m4 serial 10
+# uchar.m4 serial 11
dnl Copyright (C) 2019-2020 Free Software Foundation, Inc.
dnl This file is free software; the Free Software Foundation
dnl gives unlimited permission to copy and/or distribute it,
@@ -49,6 +49,7 @@ AC_DEFUN([gl_UCHAR_H_DEFAULTS],
[
GNULIB_BTOC32=0; AC_SUBST([GNULIB_BTOC32])
GNULIB_C32RTOMB=0; AC_SUBST([GNULIB_C32RTOMB])
+ GNULIB_C32SNRTOMBS=0; AC_SUBST([GNULIB_C32SNRTOMBS])
GNULIB_C32SRTOMBS=0; AC_SUBST([GNULIB_C32SRTOMBS])
GNULIB_C32TOB=0; AC_SUBST([GNULIB_C32TOB])
GNULIB_MBRTOC32=0; AC_SUBST([GNULIB_MBRTOC32])
diff --git a/modules/c32snrtombs b/modules/c32snrtombs
new file mode 100644
index 0000000..4ced9f2
--- /dev/null
+++ b/modules/c32snrtombs
@@ -0,0 +1,31 @@
+Description:
+c32snrtombs() function: convert 32-bit wide string to string.
+
+Files:
+lib/c32snrtombs.c
+lib/wcsnrtombs-impl.h
+lib/c32srtombs-state.c
+
+Depends-on:
+uchar
+wchar
+verify
+c32rtomb
+wcsnrtombs [test $SMALL_WCHAR_T = 0]
+
+configure.ac:
+AC_REQUIRE([gl_UCHAR_H])
+AC_LIBOBJ([c32srtombs-state])
+gl_UCHAR_MODULE_INDICATOR([c32snrtombs])
+
+Makefile.am:
+lib_SOURCES += c32snrtombs.c
+
+Include:
+<uchar.h>
+
+License:
+LGPL
+
+Maintainer:
+Bruno Haible
diff --git a/modules/uchar b/modules/uchar
index 7124a67..c7e86ed 100644
--- a/modules/uchar
+++ b/modules/uchar
@@ -30,6 +30,7 @@ uchar.h: uchar.in.h $(top_builddir)/config.status $(CXXDEFS_H)
-e 's|@''SMALL_WCHAR_T''@|$(SMALL_WCHAR_T)|g' \
-e 's/@''GNULIB_BTOC32''@/$(GNULIB_BTOC32)/g' \
-e 's/@''GNULIB_C32RTOMB''@/$(GNULIB_C32RTOMB)/g' \
+ -e 's/@''GNULIB_C32SNRTOMBS''@/$(GNULIB_C32SNRTOMBS)/g' \
-e 's/@''GNULIB_C32SRTOMBS''@/$(GNULIB_C32SRTOMBS)/g' \
-e 's/@''GNULIB_C32TOB''@/$(GNULIB_C32TOB)/g' \
-e 's/@''GNULIB_MBRTOC32''@/$(GNULIB_MBRTOC32)/g' \
diff --git a/tests/test-uchar-c++.cc b/tests/test-uchar-c++.cc
index e202bbc..ae97d9c 100644
--- a/tests/test-uchar-c++.cc
+++ b/tests/test-uchar-c++.cc
@@ -33,6 +33,11 @@ SIGNATURE_CHECK (GNULIB_NAMESPACE::c32rtomb, size_t,
(char *, char32_t , mbstate_t *));
#endif
+#if GNULIB_TEST_C32SNRTOMBS
+SIGNATURE_CHECK (GNULIB_NAMESPACE::c32snrtombs, size_t,
+ (char *, const char32_t **, size_t, size_t, mbstate_t *));
+#endif
+
#if GNULIB_TEST_C32SRTOMBS
SIGNATURE_CHECK (GNULIB_NAMESPACE::c32srtombs, size_t,
(char *, const char32_t **, size_t, mbstate_t *));
--
2.7.4
[-- Attachment #3: 0002-c32snrtombs-Add-tests.patch --]
[-- Type: text/x-patch, Size: 13052 bytes --]
From e3fb76a5a384096363eb90881f52b8535ee5a7ce Mon Sep 17 00:00:00 2001
From: Bruno Haible <bruno@clisp.org>
Date: Fri, 10 Jan 2020 23:29:57 +0100
Subject: [PATCH 2/2] c32snrtombs: Add tests.
* tests/test-c32snrtombs.c: New file, based on tests/test-wcsnrtombs.c.
* tests/test-c32snrtombs-1.sh: New file, based on
tests/test-wcsnrtombs1.sh.
* tests/test-c32snrtombs-2.sh: New file, based on
tests/test-wcsnrtombs2.sh.
* tests/test-c32snrtombs-3.sh: New file, based on
tests/test-wcsnrtombs3.sh.
* tests/test-c32snrtombs-4.sh: New file, based on
tests/test-wcsnrtombs4.sh.
* modules/c32snrtombs-tests: New file, based on
modules/wcsnrtombs-tests.
---
ChangeLog | 13 +++
modules/c32snrtombs-tests | 32 +++++++
tests/test-c32snrtombs-1.sh | 15 ++++
tests/test-c32snrtombs-2.sh | 15 ++++
tests/test-c32snrtombs-3.sh | 15 ++++
tests/test-c32snrtombs-4.sh | 15 ++++
tests/test-c32snrtombs.c | 206 ++++++++++++++++++++++++++++++++++++++++++++
7 files changed, 311 insertions(+)
create mode 100644 modules/c32snrtombs-tests
create mode 100755 tests/test-c32snrtombs-1.sh
create mode 100755 tests/test-c32snrtombs-2.sh
create mode 100755 tests/test-c32snrtombs-3.sh
create mode 100755 tests/test-c32snrtombs-4.sh
create mode 100644 tests/test-c32snrtombs.c
diff --git a/ChangeLog b/ChangeLog
index 84bc7d2..e523162 100644
--- a/ChangeLog
+++ b/ChangeLog
@@ -1,5 +1,18 @@
2020-01-10 Bruno Haible <bruno@clisp.org>
+ c32snrtombs: Add tests.
+ * tests/test-c32snrtombs.c: New file, based on tests/test-wcsnrtombs.c.
+ * tests/test-c32snrtombs-1.sh: New file, based on
+ tests/test-wcsnrtombs1.sh.
+ * tests/test-c32snrtombs-2.sh: New file, based on
+ tests/test-wcsnrtombs2.sh.
+ * tests/test-c32snrtombs-3.sh: New file, based on
+ tests/test-wcsnrtombs3.sh.
+ * tests/test-c32snrtombs-4.sh: New file, based on
+ tests/test-wcsnrtombs4.sh.
+ * modules/c32snrtombs-tests: New file, based on
+ modules/wcsnrtombs-tests.
+
c32snrtombs: New module.
* lib/uchar.in.h (c32snrtombs): New declaration.
* lib/wcsnrtombs-impl.h: Parameterize: Use macros FUNC, SCHAR_T,
diff --git a/modules/c32snrtombs-tests b/modules/c32snrtombs-tests
new file mode 100644
index 0000000..038d334
--- /dev/null
+++ b/modules/c32snrtombs-tests
@@ -0,0 +1,32 @@
+Files:
+tests/test-c32snrtombs-1.sh
+tests/test-c32snrtombs-2.sh
+tests/test-c32snrtombs-3.sh
+tests/test-c32snrtombs-4.sh
+tests/test-c32snrtombs.c
+tests/signature.h
+tests/macros.h
+m4/locale-fr.m4
+m4/locale-ja.m4
+m4/locale-zh.m4
+m4/codeset.m4
+
+Depends-on:
+setlocale
+mbstoc32s
+
+configure.ac:
+gt_LOCALE_FR
+gt_LOCALE_FR_UTF8
+gt_LOCALE_JA
+gt_LOCALE_ZH_CN
+
+Makefile.am:
+TESTS += test-c32snrtombs-1.sh test-c32snrtombs-2.sh test-c32snrtombs-3.sh test-c32snrtombs-4.sh
+TESTS_ENVIRONMENT += \
+ LOCALE_FR='@LOCALE_FR@' \
+ LOCALE_FR_UTF8='@LOCALE_FR_UTF8@' \
+ LOCALE_JA='@LOCALE_JA@' \
+ LOCALE_ZH_CN='@LOCALE_ZH_CN@'
+check_PROGRAMS += test-c32snrtombs
+test_c32snrtombs_LDADD = $(LDADD) $(LIB_SETLOCALE)
diff --git a/tests/test-c32snrtombs-1.sh b/tests/test-c32snrtombs-1.sh
new file mode 100755
index 0000000..608c6d1
--- /dev/null
+++ b/tests/test-c32snrtombs-1.sh
@@ -0,0 +1,15 @@
+#!/bin/sh
+
+# Test in an ISO-8859-1 or ISO-8859-15 locale.
+: ${LOCALE_FR=fr_FR}
+if test $LOCALE_FR = none; then
+ if test -f /usr/bin/localedef; then
+ echo "Skipping test: no traditional french locale is installed"
+ else
+ echo "Skipping test: no traditional french locale is supported"
+ fi
+ exit 77
+fi
+
+LC_ALL=$LOCALE_FR \
+${CHECKER} ./test-c32snrtombs${EXEEXT} 1
diff --git a/tests/test-c32snrtombs-2.sh b/tests/test-c32snrtombs-2.sh
new file mode 100755
index 0000000..5b437f1
--- /dev/null
+++ b/tests/test-c32snrtombs-2.sh
@@ -0,0 +1,15 @@
+#!/bin/sh
+
+# Test whether a specific UTF-8 locale is installed.
+: ${LOCALE_FR_UTF8=fr_FR.UTF-8}
+if test $LOCALE_FR_UTF8 = none; then
+ if test -f /usr/bin/localedef; then
+ echo "Skipping test: no french Unicode locale is installed"
+ else
+ echo "Skipping test: no french Unicode locale is supported"
+ fi
+ exit 77
+fi
+
+LC_ALL=$LOCALE_FR_UTF8 \
+${CHECKER} ./test-c32snrtombs${EXEEXT} 2
diff --git a/tests/test-c32snrtombs-3.sh b/tests/test-c32snrtombs-3.sh
new file mode 100755
index 0000000..bd77bf4
--- /dev/null
+++ b/tests/test-c32snrtombs-3.sh
@@ -0,0 +1,15 @@
+#!/bin/sh
+
+# Test whether a specific EUC-JP locale is installed.
+: ${LOCALE_JA=ja_JP}
+if test $LOCALE_JA = none; then
+ if test -f /usr/bin/localedef; then
+ echo "Skipping test: no traditional japanese locale is installed"
+ else
+ echo "Skipping test: no traditional japanese locale is supported"
+ fi
+ exit 77
+fi
+
+LC_ALL=$LOCALE_JA \
+${CHECKER} ./test-c32snrtombs${EXEEXT} 3
diff --git a/tests/test-c32snrtombs-4.sh b/tests/test-c32snrtombs-4.sh
new file mode 100755
index 0000000..3332297
--- /dev/null
+++ b/tests/test-c32snrtombs-4.sh
@@ -0,0 +1,15 @@
+#!/bin/sh
+
+# Test whether a specific GB18030 locale is installed.
+: ${LOCALE_ZH_CN=zh_CN.GB18030}
+if test $LOCALE_ZH_CN = none; then
+ if test -f /usr/bin/localedef; then
+ echo "Skipping test: no transitional chinese locale is installed"
+ else
+ echo "Skipping test: no transitional chinese locale is supported"
+ fi
+ exit 77
+fi
+
+LC_ALL=$LOCALE_ZH_CN \
+${CHECKER} ./test-c32snrtombs${EXEEXT} 4
diff --git a/tests/test-c32snrtombs.c b/tests/test-c32snrtombs.c
new file mode 100644
index 0000000..dcf4f55
--- /dev/null
+++ b/tests/test-c32snrtombs.c
@@ -0,0 +1,206 @@
+/* Test of conversion of 32-bit wide string to string.
+ Copyright (C) 2008-2020 Free Software Foundation, Inc.
+
+ This program is free software: you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation; either version 3 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program. If not, see <https://www.gnu.org/licenses/>. */
+
+/* Written by Bruno Haible <bruno@clisp.org>, 2008. */
+
+#include <config.h>
+
+#include <uchar.h>
+
+#include "signature.h"
+SIGNATURE_CHECK (c32snrtombs, size_t,
+ (char *, const char32_t **, size_t, size_t, mbstate_t *));
+
+#include <locale.h>
+#include <stdlib.h>
+#include <string.h>
+
+#include "macros.h"
+
+int
+main (int argc, char *argv[])
+{
+ /* configure should already have checked that the locale is supported. */
+ if (setlocale (LC_ALL, "") == NULL)
+ return 1;
+
+ if (argc > 1)
+ {
+ char32_t input[10];
+ size_t n;
+ const char32_t *src;
+ #define BUFSIZE 20
+ char buf[BUFSIZE];
+ size_t ret;
+
+ {
+ size_t i;
+ for (i = 0; i < BUFSIZE; i++)
+ buf[i] = '_';
+ }
+
+ switch (argv[1][0])
+ {
+ case '1':
+ /* Locale encoding is ISO-8859-1 or ISO-8859-15. */
+ {
+ const char original[] = "B\374\337er"; /* "Büßer" */
+
+ ret = mbstoc32s (input, original, 10);
+ ASSERT (ret == 5);
+
+ for (n = 0; n < 10; n++)
+ {
+ src = input;
+ ret = c32snrtombs (NULL, &src, 6, n, NULL);
+ ASSERT (ret == 5);
+ ASSERT (src == input);
+
+ src = input;
+ ret = c32snrtombs (buf, &src, 6, n, NULL);
+ ASSERT (ret == (n <= 5 ? n : 5));
+ ASSERT (src == (n <= 5 ? input + n : NULL));
+ ASSERT (memcmp (buf, original, ret) == 0);
+ if (src == NULL)
+ ASSERT (buf[ret] == '\0');
+ ASSERT (buf[ret + (src == NULL) + 0] == '_');
+ ASSERT (buf[ret + (src == NULL) + 1] == '_');
+ ASSERT (buf[ret + (src == NULL) + 2] == '_');
+ }
+ }
+ break;
+
+ case '2':
+ /* Locale encoding is UTF-8. */
+ {
+ const char original[] = "s\303\274\303\237\360\237\230\213!"; /* "süß😋!" */
+
+ ret = mbstoc32s (input, original, 10);
+ ASSERT (ret == 5);
+
+ for (n = 0; n < 15; n++)
+ {
+ src = input;
+ ret = c32snrtombs (NULL, &src, 6, n, NULL);
+ ASSERT (ret == 10);
+ ASSERT (src == input);
+
+ src = input;
+ ret = c32snrtombs (buf, &src, 6, n, NULL);
+ ASSERT (ret == (n < 1 ? n :
+ n < 3 ? 1 :
+ n < 5 ? 3 :
+ n < 9 ? 5 :
+ n <= 10 ? n : 10));
+ ASSERT (src == (n < 1 ? input + n :
+ n < 3 ? input + 1 :
+ n < 5 ? input + 2 :
+ n < 9 ? input + 3 :
+ n <= 10 ? input + (n - 5) : NULL));
+ ASSERT (memcmp (buf, original, ret) == 0);
+ if (src == NULL)
+ ASSERT (buf[ret] == '\0');
+ ASSERT (buf[ret + (src == NULL) + 0] == '_');
+ ASSERT (buf[ret + (src == NULL) + 1] == '_');
+ ASSERT (buf[ret + (src == NULL) + 2] == '_');
+ }
+ }
+ break;
+
+ case '3':
+ /* Locale encoding is EUC-JP. */
+ {
+ const char original[] = "<\306\374\313\334\270\354>"; /* "<日本語>" */
+
+ ret = mbstoc32s (input, original, 10);
+ ASSERT (ret == 5);
+
+ for (n = 0; n < 10; n++)
+ {
+ src = input;
+ ret = c32snrtombs (NULL, &src, 6, n, NULL);
+ ASSERT (ret == 8);
+ ASSERT (src == input);
+
+ src = input;
+ ret = c32snrtombs (buf, &src, 6, n, NULL);
+ ASSERT (ret == (n < 1 ? n :
+ n < 3 ? 1 :
+ n < 5 ? 3 :
+ n < 7 ? 5 :
+ n <= 8 ? n : 8));
+ ASSERT (src == (n < 1 ? input + n :
+ n < 3 ? input + 1 :
+ n < 5 ? input + 2 :
+ n < 7 ? input + 3 :
+ n <= 8 ? input + (n - 3) : NULL));
+ ASSERT (memcmp (buf, original, ret) == 0);
+ if (src == NULL)
+ ASSERT (buf[ret] == '\0');
+ ASSERT (buf[ret + (src == NULL) + 0] == '_');
+ ASSERT (buf[ret + (src == NULL) + 1] == '_');
+ ASSERT (buf[ret + (src == NULL) + 2] == '_');
+ }
+ }
+ break;
+
+
+ case '4':
+ /* Locale encoding is GB18030. */
+ {
+ const char original[] = "s\250\271\201\060\211\070\224\071\375\067!"; /* "süß😋!" */
+
+ ret = mbstoc32s (input, original, 10);
+ ASSERT (ret == 5);
+
+ for (n = 0; n < 15; n++)
+ {
+ src = input;
+ ret = c32snrtombs (NULL, &src, 6, n, NULL);
+ ASSERT (ret == 12);
+ ASSERT (src == input);
+
+ src = input;
+ ret = c32snrtombs (buf, &src, 6, n, NULL);
+ ASSERT (ret == (n < 1 ? n :
+ n < 3 ? 1 :
+ n < 7 ? 3 :
+ n < 11 ? 7 :
+ n <= 12 ? n : 12));
+ ASSERT (src == (n < 1 ? input + n :
+ n < 3 ? input + 1 :
+ n < 7 ? input + 2 :
+ n < 11 ? input + 3 :
+ n <= 12 ? input + (n - 7) : NULL));
+ ASSERT (memcmp (buf, original, ret) == 0);
+ if (src == NULL)
+ ASSERT (buf[ret] == '\0');
+ ASSERT (buf[ret + (src == NULL) + 0] == '_');
+ ASSERT (buf[ret + (src == NULL) + 1] == '_');
+ ASSERT (buf[ret + (src == NULL) + 2] == '_');
+ }
+ }
+ break;
+
+ default:
+ return 1;
+ }
+
+ return 0;
+ }
+
+ return 1;
+}
--
2.7.4
^ permalink raw reply related [flat|nested] only message in thread
only message in thread, other threads:[~2020-01-10 22:33 UTC | newest]
Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-01-10 22:32 new module 'c32snrtombs' Bruno Haible
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).