[SPARK-8342] Decimal Math beyond ~2^112 is broken

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: SQL
• Assignee: L. C. Hsieh
• Reporter: Rene Treffer
• Created: 13/Jun/15 13:41
• Updated: 14/Jun/15 06:58
• Resolved: 14/Jun/15 05:42

Description

Here is a snippet from the spark-shell that should not happen

scala> val d = Decimal(Long.MaxValue,100,0) * Decimal(Long.MaxValue,100,0)
d: org.apache.spark.sql.types.Decimal = 0
scala> d.toDebugString
res3: String = Decimal(expanded,0,1,0})

It looks like precision gets reseted on some operations and values are then truncated.

Issue Links

• links to: [Github] Pull Request #6797 (viirya)