Details
-
Bug
-
Status: Closed
-
Blocker
-
Resolution: Duplicate
-
1.4.4, 1.5.1
-
None
-
None
-
None
Description
ORC PPD evaluation for Date type uses java.sql.Date for min/max comparison causing incorrect results.
Date.compareTo uses millis offset which can return incorrect results depending on the timezone.
Running the testcase in HIVE-19726 passed in Los Angeles but failed in Paris as Date.compareTo return 0 for Los Angeles but returned -1 for Paris.
Similar to bloomfilter, min/max evaluation should use DateWritable (as DateWritable.compareTo uses days offset).
Attachments
Issue Links
- blocks
-
HIVE-19726 ORC date PPD is broken
- Closed
- is superceded by
-
ORC-661 DateColumnStatistics uses Date, which is not timezone agnostic.
- Closed
- relates to
-
ORC-495 [C++] BooleanRleDecoder failed to reset remainingbits to zero on seek
- Resolved
- links to