[HIVE-21234] Enforce timestamp range

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Hive
• Labels: TODOC backwards-compatibility
• Assignee: Karen Coppage
• Reporter: Karen Coppage
• Created: 08/Feb/19 09:47
• Updated: 20/Mar/19 13:55

Description

Our Wiki specifies a range for DATE, but not for TIMESTAMP (well, there's a specified format (yyyy) but no explicitly specified range). [1]

TIMESTAMP used to have inner representation of java.sql.Timestamp which couldn't handle timestamps outside of the range of years 0000-9999. (0000 converted to 0001)
Since the inner representation was changed to LocalDateTime (HIVE-20007), negative timestamps overflow because of a formatting error.
I propose simply disabling negative timestamps, and timestamps beyond year 9999. No data is much better than bad data.

See [2] for more details.

[1] https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-TimestampstimestampTimestamps
[2] https://docs.google.com/document/d/1y-GcyzzALXM2AJB3bFuyTAEq5fq6p41gu5eH1pF8I7o/edit?usp=sharing