Details
Description
Not sure if it ever were reported.
scala> val s = sc.parallelize(Seq[Option[Long]](None,Some(1L),Some(5))).toDF("v") s: org.apache.spark.sql.DataFrame = [v: bigint] scala> s.show(false) +----+ |v | +----+ |null| |1 | |5 | +----+ scala> s.as[Long].map(v => v*2).show(false) +-----+ |value| +-----+ |-2 | |2 | |10 | +-----+ scala> s.select($"v"*2).show(false) +-------+ |(v * 2)| +-------+ |null | |2 | |10 | +-------+