Description
Hive supports the LATERAL VIEW OUTER syntax to make sure that when an array is empty, the content from the outer table is still returned.
Within Spark, this is currently only possible within the HiveContext and executing HiveQL statements. It would be nice if the standard explode() DataFrame method allows the same. A possible signature would be:
explode[A, B](inputColumn: String, outputColumn: String, outer: Boolean = false)
Attachments
Issue Links
- is related to
-
SPARK-18207 class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB
-
- Resolved
-
- relates to
-
SPARK-20535 R wrappers for explode_outer and posexplode_outer
-
- Resolved
-
- links to
