[GOBBLIN-514] AvroUtils#parseSchemaFromFile fails when characters are written with Modified UTF-8 encoding

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Assignee: Aditya Sharma
• Reporter: Aditya Sharma
• Created: 12/Jun/18 13:47
• Updated: 03/Aug/18 18:05
• Resolved: 14/Jun/18 22:59

Description

Schema.Parser()#parse(InputStream) tries to read the bytes with character encoding UTF-8 and fails when data is encoded with modified UTF-8. Reading the schema file with UTF-8 and then converting it to schema should solve this problem.

As a part of https://github.com/apache/incubator-gobblin/pull/2355 schema is created using Hive Columns, which will be written to the disk using modified UTF-8. When such a file is read using Schema.Parser()#parse(InputStream) it fails.

Issue Links

• is related to: GOBBLIN-485 AvroSchemaManager does not support using schema generated from Hive columns