[SPARK-44973] Fix ArrayIndexOutOfBoundsException in conv()

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.3, 3.3.3, 3.4.1, 3.5.0
• Fix Version/s: 3.4.2, 4.0.0, 3.5.1, 3.3.4
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Mark Jarvin
• Reporter: Gera Shegalov
• Created: 25/Aug/23 21:05
• Updated: 21/Nov/23 22:16
• Resolved: 21/Nov/23 19:39

Description

scala> sql(s"SELECT CONV('${Long.MinValue}', 10, -2)").show(false)
java.lang.ArrayIndexOutOfBoundsException: -1
  at org.apache.spark.sql.catalyst.util.NumberConverter$.convert(NumberConverter.scala:183)
  at org.apache.spark.sql.catalyst.expressions.Conv.nullSafeEval(mathExpressions.scala:463)
  at org.apache.spark.sql.catalyst.expressions.TernaryExpression.eval(Expression.scala:821)
  at org.apache.spark.sql.catalyst.expressions.ToPrettyString.eval(ToPrettyString.scala:57)
  at org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.org$apache$spark$sql$catalyst$optimizer$ConstantFolding$$constantFolding(expressions.scala:81)
  at org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.$anonfun$constantFolding$4(expressions.scala:91)

Issue Links

• links to: GitHub Pull Request #43880