Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21043

Add unionByName API to Dataset

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • SQL
    • None

    Description

      It would be useful to add unionByName which resolves columns by name, in addition to the existing union (which resolves by position).

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-21316 Dataset Union output is not consistent with the column sequence

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-19615 Provide Dataset union convenience for divergent schema

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-21897 Add unionByName API to DataFrame in Python and R

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #18300 [Github] Pull Request #18300 (maropu)

          Activity

            People

              maropu Takeshi Yamamuro
              rxin Reynold Xin
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: