Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13721

Add support for LATERAL VIEW OUTER explode()

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Hive supports the LATERAL VIEW OUTER syntax to make sure that when an array is empty, the content from the outer table is still returned.

      Within Spark, this is currently only possible within the HiveContext and executing HiveQL statements. It would be nice if the standard explode() DataFrame method allows the same. A possible signature would be:

      explode[A, B](inputColumn: String, outputColumn: String, outer: Boolean = false)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bograd Bogdan Raducanu
                Reporter:
                hellstorm Ian Hellstrom
              • Votes:
                2 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: