[NIFI-5491] PutHive3Streaming incorrectly handles bytes, shorts, and nested structs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.8.0
• Component/s: Extensions
• Assignee: Matt Burgess
• Reporter: Matt Burgess
• Created: 06/Aug/18 15:49
• Updated: 14/Aug/18 14:18
• Resolved: 06/Aug/18 18:34

Description

When trying to insert a record into a Hive table using PutHive3Streaming, if the table contains columns of types byte, short, or struct, then an error occurs and the records cannot be written.

This is due to a mismatch between the data types used in the NiFi Record API and the Hive ORC writer and StructObjectInspector. For byte and short, NiFi currently maintains an Integer value but Hive expects a Byte or Short, respectively. For structs, NiFi maintains a Map value but Hive expects a List or array.

NiFiRecordSerDe should handle the conversion of values for use by Hive Streaming.

Issue Links

• relates to: NIFI-5517 PutHive3Streaming does not correctly support all Hive types
• links to: GitHub Pull Request #2938