[HIVE-9298] Support reading alternate timestamp formats

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: Serializers/Deserializers
• Labels: TODOC1.2
• Assignee: Jason Dere Assign to me
• Reporter: Jason Dere
• Created: 07/Jan/15 21:22
• Updated: 03/Oct/17 23:49
• Resolved: 02/Feb/15 17:05

Description

There are some users who want to be able to parse ISO-8601 timestamps, as well to set their own custom timestamp formats. We may be able to support this in LazySimpleSerDe through the use of a SerDe parameter to specify one or more alternative timestamp patterns to use to parse timestamp values from string.
If we are doing this it might also be nice to work in support for HIVE-3844, to parse numeric strings as timestamp by treating the numeric value as millis since Unix epoch. This can be enabled through the SerDe params as well.

Issue Links

• is related to: HIVE-3844 Unix timestamps don't seem to be read correctly from HDFS as Timestamp column
• is related to: HIVE-9564 Extend HIVE-9298 for JsonSerDe
• relates to: IMPALA-5766 Add date/timestamp format options to external tables
• links to: https://reviews.apache.org/r/29898/