Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10605

collect_list() and collect_set() should accept struct types as argument

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.5.0
    • 2.0.0
    • SQL
    • None

    Description

      Hive already supports this according to https://issues.apache.org/jira/browse/HIVE-10427.
      Currently Spark-sql still supports only primitive types.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-13335 Optimize Data Frames collect_list and collect_set with declarative aggregates

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Pull request #11004 [Github] Pull Request #11004 (hvanhovell)

          Pull request #12874 [Github] Pull Request #12874 (hvanhovell)

          Activity

            People

              hvanhovell Herman van Hövell
              chufang88 Mike Fang
              Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: