[HIVE-19726] ORC date PPD is broken

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0, 2.4.0, 3.0.1, 4.0.0
• Fix Version/s: 3.1.0, 2.4.0, 4.0.0-alpha-1
• Target Version/s: 3.1.0, 2.4.0, 3.0.1, 4.0.0
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 29/May/18 06:24
• Updated: 21/Oct/22 07:00
• Resolved: 30/May/18 21:01

Description

When kryo was in version 2.22 we added a fix in HIVE-7222 and later in HIVE-10819. Now that we have updated kryo to 3.0.3 that old workaround fix was never removed. The issue was that kryo serialized Timestamp to Date type. So to recover the timestamp, during deserialization we deserialized any date instance to Timestamp object which is wrong (we don't know if date was serialized as date or timestamp serialized as date in first place). This breaks PPD on date time as kryo deserialization always converts Date to Timestamp breaking PPD because of type mismatch.
Now that we have newer kryo version we can remove the code added in HIVE-10819.

Issue Links

• is blocked by: ORC-370 ORC column statistics should not use java.sql.Date
• is related to: HIVE-19742 Fix test added in HIVE-19726 by running with -Duser.timezone="Europe/Paris"