[HIVE-20375] Json SerDe ignoring the timestamp.formats property

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Assignee: Ashutosh Chauhan
• Reporter: Slim Bouguerra
• Created: 13/Aug/18 16:11
• Updated: 11/Feb/19 18:45

Description

JsonSerd is supposed to accept "timestamp.formats" SerDe property to allow different timestamp formats, after recent refactor I see that this is not working anymore.

Looking at the code I can see that The serde is not using the constructed parser with added format https://github.com/apache/hive/blob/1105ef3974d8a324637d3d35881a739af3aeb382/serde/src/java/org/apache/hadoop/hive/serde2/json/HiveJsonStructReader.java#L82

But instead it is using Converter
https://github.com/apache/hive/blob/1105ef3974d8a324637d3d35881a739af3aeb382/serde/src/java/org/apache/hadoop/hive/serde2/json/HiveJsonStructReader.java#L324

Then converter is using org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorConverter.TimestampConverter

This converter does not have any knowledge about user formats or what so ever...
It is using this static converter org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorUtils#getTimestampFromString

Issue Links

• is related to: HIVE-20900 serde2.JsonSerDe no longer supports timestamp.formats
• is superceded by: HIVE-21240 JSON SerDe Re-Write