[AVRO-1593] C++ json encoder assumes "C" locale and generates invalid UTF-8 sequence

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.7.7
• Fix Version/s: 1.9.0
• Component/s: c++

Environment

windows-1252 encoding

• Assignee: Hatem Helal
• Reporter: Hatem Helal
• Created: 10/Oct/14 10:32
• Updated: 24/Oct/19 08:25
• Resolved: 26/Aug/15 21:34

Description

encoding a multibyte UTF-8 code point such as:

"\xEF\xBD\x81"

Incorrectly becomes:

"\xEF\xBD\U0081"

When encoded in the service running in the windows-1252 locale. This isn¹t a valid UTF-8 sequence so we end up with Mojibake when reading back the JSON encoded string.