[HIVE-26233] Problems reading back PARQUET timestamps above 10000 years

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-2
• Labels: backwards-compatibility pull-request-available timestamp
• Assignee: Peter Vary
• Reporter: Peter Vary
• Created: 17/May/22 12:42
• Updated: 16/Nov/22 13:50
• Resolved: 26/May/22 15:16

Description

Timestamp values above year 10000 are not supported, but during the migration from Hive2 to Hive3 some might appear because of TZ issues. We should be able to at least read these tables before rewriting the data.

For this we need to change the Timestamp.PRINT_FORMATTER, so no + sign is appended to the timestamp if the year exceeds 4 digits.

Issue Links

• depends upon: HIVE-24074 Incorrect handling of timestamp in Parquet/Avro when written in certain time zones in versions before Hive 3.x
• is caused by: HIVE-20007 Hive should carry out timestamp computations in UTC
• links to: GitHub Pull Request #3295