Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4689

Unioning 2 SchemaRDDs should return a SchemaRDD in Python, Scala, and Java

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:
    • Target Version/s:

      Description

      Currently, you need to use unionAll() in Scala.

      Python does not expose this functionality at the moment.

      The current work around is to use the UNION ALL HiveQL functionality detailed here: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Union

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              cfregly Chris Fregly
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: