[CALCITE-6522] MAP_KEYS and MAP_VALUES function should throw if a key value is null

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.37.0
• Fix Version/s: 1.38.0
• Component/s: core
• Labels: pull-request-available
• Assignee: Caican Cai
• Reporter: Caican Cai
• Created: 08/Aug/24 16:00
• Updated: 5 days ago 22:41
• Resolved: 5 days ago 22:41

Description

scala> val df = spark.sql("select map_keys(map(null,0))");
df: org.apache.spark.sql.DataFrame = [map_keys(map(NULL, 0)): array<void>]

scala> df.show();
org.apache.spark.SparkRuntimeException: [NULL_MAP_KEY] Cannot use null as map key.
at org.apache.spark.sql.errors.QueryExecutionErrors$.nullAsMapKeyNotAllowedError(QueryExecutionErrors.scala:445)
at org.apache.spark.sql.catalyst.util.ArrayBasedMapBuilder.put(ArrayBasedMapBuilder.scala:56)
at org.apache.spark.sql.catalyst.expressions.CreateMap.eval(complexTypeCreator.scala:248)

scala> val df = spark.sql("select map_values(map(cast(null as int),0, 'foo', 1))");
df: org.apache.spark.sql.DataFrame = [map_values(map(CAST(NULL AS INT), 0, foo, 1)): array<int>]

scala> df.show()
org.apache.spark.SparkRuntimeException: [NULL_MAP_KEY] Cannot use null as map key.
at org.apache.spark.sql.errors.QueryExecutionErrors$.nullAsMapKeyNotAllowedError(QueryExecutionErrors.scala:445)

Issue Links

• blocks: CALCITE-6582 Release Calcite 1.38.0
• relates to: CALCITE-6300 Function MAP_VALUES/MAP_KEYS gives exception when mapValueType and mapKeyType do not equal map biggest mapKeytype or mapValueType
• links to: GitHub Pull Request #3909