[FLINK-3665] Range partitioning lacks support to define sort orders

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: API / DataSet
• Assignee: Dawid Wysakowicz
• Reporter: Fabian Hueske
• Created: 24/Mar/16 11:43
• Updated: 01/Oct/19 15:39
• Resolved: 20/Apr/16 23:41

Description

DataSet.partitionByRange() does not allow to specify the sort order of fields. This is fine if range partitioning is used to reduce skewed partitioning.
However, it is not sufficient if range partitioning is used to sort a data set in parallel.

Since DataSet.partitionByRange() is @Public API and cannot be easily changed, I propose to add a method withOrders(Order... orders) to PartitionOperator. The method should throw an exception if the partitioning method of PartitionOperator is not range partitioning.