[XALANJ-2560] ToXMLStream does not support unicode supplementary characters

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1
• Component/s: Serialization
• Security Level: No security risk; visible to anyone (Ordinary problems in Xalan projects. Anybody can view the issue.)
• Labels: serialization unicode
• Environment: Xalan 2.7.1 serializer.; Tested on Ubuntu 12.04 with Oracle JDK 1.7.0_05.
• Assignee: Joe Kesselman
• Reporter: Damien Guillaume
• Created: 16/Aug/12 14:44
• Updated: 27/Jan/24 15:48
• Resolved: 27/Jan/24 15:48

Description

org.apache.xml.serializer.ToXMLStream (which extends ToStream) does not support serialization of unicode supplementary characters such as U+1D49C. It creates invalid characters entities like "��" instead of "𝒜" (or F0 9D 92 9C with UTF-8). ToXMLStream is used by LSSerializer when Xalan's serializer is on the classpath.

org.apache.xml.serialize.DOMSerializerImpl (included in Xerces) does not have this problem, but it is deprecated since Xerces 2.9.0, so this is a regression.

See http://stackoverflow.com/questions/11952289/serializing-supplementary-unicode-characters-into-xml-documents-with-java for more details.

Issue Links

• relates to: XALANJ-2419 Astral characters written as a pair of NCRs with the surrogate scalar values when using UTF-8