[SPARK-7320] Add rollup and cube support to DataFrame Java/Scala DSL

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: SQL
• Labels: starter
• Sprint: Spark 1.5 doc/QA sprint
• Assignee: Cheng Hao
• Reporter: Reynold Xin
• Created: 02/May/15 06:58
• Updated: 21/May/15 06:18
• Resolved: 21/May/15 02:58

Description

We should add two functions to GroupedData in order to support rollup and cube for the DataFrame DSL.

def rollup(): GroupedData
def cube(): GroupedData

These two should return new GroupedData with the appropriate state set so when we run an Aggregate, we translate the underlying logical operator into Rollup or Cube.

Issue Links

• blocks: SPARK-7783 Add rollup and cube support to DataFrame Python DSL
• links to: [Github] Pull Request #6257 (chenghao-intel)
• links to: [Github] Pull Request #6304 (chenghao-intel)
• links to: [Github] Pull Request #6312 (chenghao-intel)