[PARQUET-1064] Deprecate type-defined sort ordering for INTERVAL type

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: format-2.5.0
• Assignee: Zoltan Ivanfi
• Reporter: Zoltan Ivanfi
• Created: 20/Jul/17 17:29
• Updated: 18/Apr/18 12:22
• Resolved: 09/Jan/18 14:49

Description

LogicalTypes.md in parquet-format defines the the sort order for INTERVAL to be produced by sorting by the value of months, then days, then milliseconds with unsigned comparison.

According to these rules, 1d0h0s > 0d48h0s, which is counter-intuitive and does not seem to have any practical uses. Unless somebody is aware of an actual use-case in which this makes sense, I think the sort order should be undefined instead. The reference implementation in parquet-mr already considers the ordering to be unknown.

Issue Links

• links to: PR #76