[COCOON-2352] XMLEncoder doesn't support Unicode surrogate pairs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.12
• Fix Version/s: 2.1.13
• Component/s: * Cocoon Core, Blocks: Serializers
• Assignee: Francesco Chicchiriccò
• Reporter: Ben Fortuna
• Created: 19/Aug/16 05:06
• Updated: 20/Oct/16 12:28
• Resolved: 13/Oct/16 06:51

Description

Whilst investigating an issue with the Sling project and support for emoji characters, I've come to notice that the XMLEncoder used by HTMLSerializer doesn't support Unicode surrogate pairs to represent higher order unicode characters.

A simple unit test that demonstrates this issue is here:

https://github.com/micronode/whistlepost/blob/master/whistlepost-rewrite-lib/src/test/groovy/org/apache/cocoon/components/serializers/encoding/XMLEncoderTest.groovy

More background info here also: SLING-5973

This seems to have been identified/addressed in other Apache projects also:

https://issues.apache.org/jira/browse/THRIFT-3403?jql=text%20~%20%22surrogate%20pairs%22

Issue Links

• is related to: SLING-5973 HTMLSerializer not handling some unicode characters (emoji, etc.)
• requires: COCOON-2356 Set source and target compatibility to JDK 1.5
• links to: GitHub Pull Request #1
• links to: GitHub Pull Request #2
• links to: GitHub Pull Request #3