From: Stefan Sperling
To: source-changes@cvs.openbsd.org
Subject: CVS: cvs.openbsd.org: src
Date: Tue, 27 Jul 2010 10:59:04 -0600 (MDT)

CVSROOT: /cvs
Module name: src
Changes by: stsp@cvs.openbsd.org 2010/07/27 10:59:04

Modified files:
distrib/special/libstubs: Makefile
lib/libc : Makefile.inc
lib/libc/citrus: citrus_ctype.h citrus_ctype_local.h
lib/libc/locale: Makefile.inc runetable.c setrunelocale.c
share/locale/ctype: Makefile
Added files:
distrib/special/libstubs: mbrtowc_sb.c
lib/libc/citrus: Makefile.inc citrus_ctype.c citrus_none.c
citrus_none.h citrus_utf8.c citrus_utf8.h
lib/libc/locale: btowc.c mblen.c mbrlen.c mbstowcs.c mbtowc.c
multibyte.h multibyte_citrus.c wcscoll.c
wcstombs.c wcsxfrm.c wctob.c wctomb.c
Removed files:
lib/libc/locale: mbrtowc_sb.c multibyte_sb.c

Log message:
Replace the single-byte placeholders for the multi-byte/wide-character
conversion interfaces of libc (mbrtowc(3) and friends) with new
implementations that internally call an API based on NetBSD's citrus.
This allows us to support locales with multi-byte character encodings.

Provide two implementations of the citrus-based API: one based on the old
single-byte placeholders for use with our existing single-byte character
locales (C, ISO8859-*, KOI8, CP1251, etc.), and one that provides support
for UTF-8 encoded characters (code based on FreeBSD's implementation).

Install the en_US.UTF-8 ctype locale support file, and allow the UTF-8
ctype locale to be enabled via setlocale(3) (export LC_CTYPE='en_US.UTF-8').

A lot of programs, especially from ports, will now start using UTF-8 if the
UTF-8 locale is enabled. Use at your own risk, and please report any breakage.
Note that ncurses-based programs cannot display UTF-8 right now, this is being
worked on.

To prevent install media growth, add vfprintf(3) and mbrtowc(3) to libstubs.
The mbrtowc stub was copied unchanged from its old single-byte placeholder.
vfprintf.c doesn't need to be copied, just put in .PATH (hint by fgsch@).

Testing by myself, naddy, sthen, nicm, espie, armani, Dmitrij D. Czarkoff.

ok matthieu espie millert sthen nicm deraadt

From: Christian Weisgerber

To: ports-changes@cvs.openbsd.org
Subject: CVS: cvs.openbsd.org: ports
Date: Wed, 28 Jul 2010 14:25:11 -0600 (MDT)

CVSROOT: /cvs
Module name: ports
Changes by: naddy@cvs.openbsd.org 2010/07/28 14:25:11

Modified files:
shells/bash : Makefile

Log message:
Enable multibyte support. Makes regression tests happier.