[THRIFT-2087] unicode decode errors

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9
• Fix Version/s: 0.14.0
• Component/s: Python - Compiler

Environment

Ubuntu 12.10 (GNU/Linux 3.5.0-17-generic x86_64), python 2.7

• Patch Info: Patch Available
• Assignee: Emmanuel Brard
• Reporter: Aleksey Maslennikov
• Created: 10/Jul/13 13:38
• Updated: 11/Feb/21 22:27
• Resolved: 22/Jun/20 20:53

Description

If the supplied string is not valid utf-8 there is an exception:

self.match = iprot.readString().decode('utf-8')
File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode
return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xf2 in position 0: invalid continuation byte

Issue Links

• is related to: THRIFT-5303 Unicode decode errors in _fast_decode
• links to: GitHub Pull Request #2184