[SPARK-34695] Overflow in round trip conversion from micros to duration

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 10/Mar/21 17:21
• Updated: 11/Mar/21 15:21
• Resolved: 11/Mar/21 15:21

Description

The code below fails with long overflow:

scala> import org.apache.spark.sql.catalyst.util.IntervalUtils._
import org.apache.spark.sql.catalyst.util.IntervalUtils._

scala> val minDuration = microsToDuration(Long.MinValue)
minDuration: java.time.Duration = PT-2562047788H-54.775808S

scala> durationToMicros(minDuration)
java.lang.ArithmeticException: long overflow
  at java.lang.Math.multiplyExact(Math.java:892)
  at org.apache.spark.sql.catalyst.util.IntervalUtils$.durationToMicros(IntervalUtils.scala:782)
  ... 49 elided

Issue Links

• links to: [Github] Pull Request #31799 (MaxGekk)
• links to: [Github] Pull Request #31799 (MaxGekk)