[LANG-857] StringIndexOutOfBoundsException in CharSequenceTranslator

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.2
• Component/s: lang.text.translate.*
• Labels: patch
• Assignee: Unassigned
• Reporter: Kazuki Hamasaki
• Created: 20/Nov/12 12:36
• Updated: 21/Oct/13 05:46
• Resolved: 20/Nov/12 20:47

Description

I found that there is bad surrogate pair handling in the CharSequenceTranslator

This is a simple test case for this problem.
\uD83D\uDE30 is a surrogate pair.

@Test
public void testEscapeSurrogatePairs() throws Exception {
    assertEquals("\uD83D\uDE30", StringEscapeUtils.escapeCsv("\uD83D\uDE30"));
}

You'll get the exception as shown below.

java.lang.StringIndexOutOfBoundsException: String index out of range: 2
	at java.lang.String.charAt(String.java:658)
	at java.lang.Character.codePointAt(Character.java:4668)
	at org.apache.commons.lang3.text.translate.CharSequenceTranslator.translate(CharSequenceTranslator.java:95)
	at org.apache.commons.lang3.text.translate.CharSequenceTranslator.translate(CharSequenceTranslator.java:59)
	at org.apache.commons.lang3.StringEscapeUtils.escapeCsv(StringEscapeUtils.java:556)

Patch attached, the method affected:

1. public final void translate(CharSequence input, Writer out) throws IOException

Issue Links

• is duplicated by: LANG-862 CharSequenceTranslator causes StringIndexOutOfBoundsException during translation of unicode codepoints with length > 1 character