[SPARK-11410] Add a DataFrame API that provides functionality similar to HiveQL's DISTRIBUTE BY

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.5.1
• Fix Version/s: 1.6.0
• Component/s: SQL
• Target Version/s: 1.6.0
• Assignee: Nong Li
• Reporter: Nong Li
• Created: 29/Oct/15 21:50
• Updated: 13/Dec/15 22:37
• Resolved: 01/Nov/15 22:36

Description

DISTRIBUTE BY allows the user to control the partitioning and ordering of a data set which can be very useful for some applications.

Issue Links

• is related to: SPARK-11504 API audit for distributeBy and localSort
• is related to: SPARK-4849 Pass partitioning information (distribute by) to In-memory caching
• links to: [Github] Pull Request #9364 (nongli)
• links to: [Github] Pull Request #9504 (nongli)