Proposed Updates for UTR #36 and UTS #39 now open for review

The Unicode Technical Committee has posted two new issues for public review and comment.

PRI #257, Proposed Update UTR #36, Unicode Security Considerations
PRI #258, Proposed Update UTR #39, Unicode Security Mechanisms

The data for Unicode Technical Standard #39, Unicode Security Mechanisms, has been updated for Unicode 6.3, and there are some important additional changes to the recommended characters for identifiers. There is a new Restriction Level defined in UTS #39, and textual clarifications and fixes to both UTS #39 and UTR #36.

Unicode Technical Report #36, Unicode Security Considerations, is being updated in conjunction with the update of UTS #39 for Unicode 6.3.

As part of this public review, the UTC is soliciting information about links to relevant articles and blog posts which have a bearing on Unicode-related security issues.

Review periods for the new items close on January 27, 2014.

Feedback on repertoire for ISO/IEC 10646:2014 (4th Edition)

ISO/IEC 10646:2014 (4th Edition) is currently in its DIS ballot stage. Additionally, Amendment 1 to ISO/IEC 10646:2014 (4th Edition) is currently in its PDAM ballot stage. Documents showing the Draft Additional Repertoire for ISO/IEC 10646:2014 (4th Edition) and the Draft Additional Repertoire for Amendment 1 to ISO/IEC 10646:2014 (4th Edition) are posted in the UTC Document Register, for reference and feedback.

There is a short window of opportunity to review and comment on these major repertoire additions for the 4th Edition, before the ISO balloting has been completed — at which point no further changes or corrections will be possible. (See http://www.unicode.org/faq/sdos.html for additional information on the stages in ISO standards development.)

The UTC is soliciting feedback on the draft additional repertoire, to help discover any errors in character names, incorrect glyphs, or other problems in the repertoire under ballot. Such feedback will help inform the UTC discussions about its own contribution to the ISO balloting process.

Please see the PRI pages for details and links to the documents for review:

255 Feedback on repertoire for Amendment 1 to ISO/IEC 10646:2014 (4th Edition)
256 Feedback on repertoire for ISO/IEC 10646:2014 (4th Edition)

Please also see the general instructions for Public Review Issues.

Announcing The Unicode Standard, Version 6.3

The Unicode Consortium announces Version 6.3 of the Unicode Standard and with it, significantly improved bidirectional behavior. The updated Version 6.3 Unicode Bidirectional Algorithm now ensures that pairs of parentheses and brackets have consistent layout and provides a mechanism for isolating runs of text.

Based on contributions from major browser developers, the updated Bidirectional Algorithm and five new bidi format characters will improve the display of text for hundreds of millions of users of Arabic, Hebrew, Persian, Urdu, and many others. The display and positioning of parentheses will better match the normal behavior that users expect. By using the new methods for isolating runs of text, software will be able to construct messages from different sources without jumbling the order of characters. The new bidi format characters correspond to features in markup (such as in CSS). Overall, these improvements also bring greater interoperability and an improved ability for inserting text and assembling user interface elements.

The improvements come with new rigor: the Consortium now offers two reference implementations and greatly improved testing and test data.

In a major enhancement for CJK usage, this new version adds standardized variation sequences for all 1,002 CJK compatibility ideographs. These sequences address a well-known issue of the CJK compatibility ideographs — that they could change their appearance when any process normalized the text. Using the new standardized variation sequences allows authors to write text which will preserve the specific required shapes of these CJK ideographs, even under Unicode normalization.

Version 6.3 includes other improvements as well:

• Improved Unihan data to better align with ISO/IEC 10646
• Better support for Hebrew word break behavior and for ideographic space in line breaking

Get started with Unicode 6.3 today! http://www.unicode.org/versions/Unicode6.3.0/

CLDR Version 24 released

Unicode CLDR 24 has been released, providing an update to the key building blocks for software supporting the world's languages. This data is used by a wide spectrum of companies for their software internationalization and localization, adapting software to the conventions of different languages for such common software tasks.
Unicode CLDR 24 focused on additional structure for formatting units, dates, and times, and improving data coverage. This version contains data for 238 languages and 259 territories—740 locales in all. Ten languages were added to the 100%-modern-coverage list for a total of 70 languages. Between the new languages, and the new structure, more data was entered than in any previous release.

The new structure focused primarily on formatting of units and improvements to date and time formatting.

• fractional plural forms. major extension to handle fractions (eg, some languages use the equivalent of “1.2 teaspoons” but “2.1 teaspoon”)
• measurement units. many additional unit types (“10.3 kg”), in up to 6 plural forms per language
• compound units. video length: "23 hrs, 7 mins", or "23:07"
• dates/times. new relative fields such as "last Sunday", and "now"; 12 hour time formats that omit "am/pm"; neutral eras ("405 BCE"); additional timezone falback regional patterns ("{city} Daylight Time")
• number formatting. exponential notation (1.42×10²³), at-least ("99+"), ranges ("3.5-4.5 kg"), narrow currency symbols (both "US$12.23" and "$12.23").
• collation. major simplification of rule syntax, updated root files to Unicode 6.3; preliminary version of European Ordering Rules; documentation of the CLDR Collation Algorithm (extending UCA)
• JSON. improved support, including new structure and data.

In addition, the data already present from CLDR v23 was reviewed for the supported languages, and many improvements made.

Details of coverage improvements and new features are provided in http://cldr.unicode.org/index/downloads/cldr-24, along with a detailed Migration section.

---

About the Unicode Consortium
The Unicode Consortium is a non-profit organization founded to develop, extend and promote use of the Unicode Standard and related globalization standards. The membership of the consortium represents a broad spectrum of corporations and organizations in the computer and information processing industry. Members are: Adobe Systems, Apple, Google, Government of Andhra Pradesh, Government of Bangladesh, Government of India, IBM, Microsoft, Monotype Imaging, Sultanate of Oman MARA, Oracle, SAP, Tamil Virtual University, The University of California (Berkeley), Yahoo!, plus well over a hundred Associate, Liaison, and Individual members. For more information, please contact the Unicode Consortium:
http://www.unicode.org/contacts.html.

Henry Luce Foundation Grant to Unicode in Support of Encoding Tangut

The Consortium is very pleased to announce the generous grant made by the Henry Luce Foundation to support progress on encoding Tangut. The Luce Foundation has made a one-time grant to the Unicode Consortium to support a December 2013 meeting to further progress the Tangut script for its eventual incorporation into the Unicode Standard and the associated ISO/IEC 10646 International Standard. The meeting will bring together scholars of Tangut and experts in the character encoding process to agree on the character repertoire for this large and complex script. Work on this grant is directed by Dr. Deborah Anderson, Technical Director of the Consortium and the Project Leader of the UC Berkeley's Script Encoding Initiative.

UTR #50, Unicode Vertical Text Layout, now published

The Unicode Consortium is pleased to announce the first published version of UTR #50, Unicode Vertical Text Layout. Up until now, vertical text layout has been challenging for implementers due to the somewhat ambiguous nature of character orientation, and often relied on information that is buried deep within font formats. This Unicode Technical Report lays the groundwork for a non-ambiguous vertical text layout model that can serve a broad range of environments. Details can be found at http://www.unicode.org/reports/tr50/.

For general information about Unicode Technical Reports, please see http://www.unicode.org/reports/about-reports.html

Testing the Unicode Bidirectional Algorithm for Unicode 6.3

Unicode Standard Annex #9, Unicode Bidirectional Algorithm (UBA), has a major update slated for release in September, 2013. This update is the most significant change in Unicode 6.3. The changes to the algorithm and text have been already been approved by the Unicode Technical Committee, subject to final editorial review.

The Unicode Technical Committee is encouraging implementations to test their code against the new test files and the two reference implementations during the month of July, 2013. It is vital that the interpretation of the text of the specification in UAX #9 be absolutely clear, and that the values in the test data be thoroughly tested by at least two implementations before release, because any changes after release—even to fix problems—can cause significant interoperability problems. The UBA is used for displaying all Arabic and Hebrew text on the web and in application programs, so there are significant ramifications for any changes to the algorithm.

The proposed update to UAX #9 involves a substantial extension of the UBA to allow for the implementation of isolate runs, introducing new Bidi_Class property values and formatting characters in support of that extension. There are also changes to Section 3.3.5, Resolving Neutral and Isolate Formatting Types to resolve paired punctuation marks as a unit. For details, see http://www.unicode.org/reports/tr9/tr9-28.html.

For further information about the review see http://www.unicode.org/review/pri254/.

CLDR Version 23.1 Released

May 15, 2013 — Unicode CLDR 23.1 has been released, providing an update to the key building blocks for software supporting the world's languages. Unicode CLDR 23.1 contains data for 215 languages and 228 territories—657 locales in all. Unicode CLDR 23.1 is an update release, designed to address specific issues that have arisen since the initial publish of CLDR 23. The release also contains enhancements and fixes to the JSON conversion utility, as well as a downloadable sample of JSON format data for CLDR.

For more details on the contents of CLDR 23.1, please refer to the release note located at:

http://cldr.unicode.org/index/downloads/cldr-23-1