Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8992

Add Pivot functionality to Spark SQL

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.6.0
    • SQL
    • None

    Description

      SQLServer and other databases provide capabilities to transpose data from columns to rows and rows to columns, the later is very useful for analytic use cases like turning rows into feature columns for an MLlib model. Here is a reference for the SQLServer implementation: http://sqlhints.com/2014/03/10/pivot-and-unpivot-in-sql-server/

      Additional Referenced Request:
      http://stackoverflow.com/questions/30244910/pivot-spark-dataframe

      Attachments

        Issue Links

          Activity

            People

              a1ray Andrew Ray
              superhadooper Richard Williamson
              Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: