Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-6116 DataFrame API improvement umbrella ticket (Spark 1.5)
  3. SPARK-7320

Add rollup and cube support to DataFrame Java/Scala DSL

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: SQL
    • Labels:
    • Sprint:
      Spark 1.5 doc/QA sprint

      Description

      We should add two functions to GroupedData in order to support rollup and cube for the DataFrame DSL.

      def rollup(): GroupedData
      def cube(): GroupedData
      

      These two should return new GroupedData with the appropriate state set so when we run an Aggregate, we translate the underlying logical operator into Rollup or Cube.

        Attachments

          Activity

            People

            • Assignee:
              chenghao Cheng Hao
              Reporter:
              rxin Reynold Xin
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: