Details
-
Documentation
-
Status: Resolved
-
Trivial
-
Resolution: Fixed
-
3.0.2, 3.1.0
-
None
Description
The documentation of Spark SQL's null semantics is (I believe) incorrect.
The documentation states that "NULL AND False" yields NULL, when in fact it yields False.
Seq[(java.lang.Boolean, java.lang.Boolean)](
(true, null),
(false, null),
(null, true),
(null, false),
(null, null)
)
.toDF("left_operand", "right_operand")
.withColumn("OR", 'left_operand || 'right_operand)
.withColumn("AND", 'left_operand && 'right_operand)
.show(truncate = false)
+------------+-------------+----+-----+
|left_operand|right_operand|OR |AND |
+------------+-------------+----+-----+
|true |null |true|null |
|false |null |null|false|
|null |true |true|null |
|null |false |null|false| <---- this line is incorrect in the docs
|null |null |null|null |
+------------+-------------+----+-----+
