Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Not A Problem
-
2.1.1
-
None
-
None
Description
from pyspark.sql import Row from pyspark.sql.functions import explode eDF = spark.createDataFrame([Row(a=1, intlist=[1,2], mapfield={"a": "b"}), Row(a=2, intlist=[], mapfield={"a": "b"})]) eDF = eDF.withColumn('another', explode(eDF.intlist)).collect() eDF
The `a=2` row is missing in the output