[ORC-726] Support Map type in `orc-tools convert`

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.7.0
• Fix Version/s: 1.7.0
• Component/s: tools
• Assignee: Yiqun Zhang
• Reporter: Dongjoon Hyun
• Created: 12/Jan/21 01:36
• Updated: 21/Sep/21 20:44
• Resolved: 19/Aug/21 16:53

Description

$ orc-tools version
ORC 1.6.6

$ orc-tools convert examples/orc-file-11-format.orc
Merging schema from examples/orc-file-11-format.orc
Exception in thread "main" java.lang.IllegalArgumentException: Unhandled type map<string,struct<int1:int,string1:string>>
	at org.apache.orc.tools.json.JsonSchemaFinder.makeHiveType(JsonSchemaFinder.java:315)
	at org.apache.orc.tools.json.JsonSchemaFinder.makeHiveType(JsonSchemaFinder.java:302)
	at org.apache.orc.tools.json.JsonSchemaFinder.addSchema(JsonSchemaFinder.java:320)
	at org.apache.orc.tools.convert.ConvertTool.buildSchema(ConvertTool.java:78)
	at org.apache.orc.tools.convert.ConvertTool.<init>(ConvertTool.java:185)
	at org.apache.orc.tools.convert.ConvertTool.main(ConvertTool.java:165)
	at org.apache.orc.tools.Driver.main(Driver.java:116)

Issue Links

• relates to: ORC-735 ConvertTool should not fail at a single ORC file
• relates to: ORC-452 Support converting MAP column from JSON to ORC
• links to: GitHub Pull Request #875