[SPARK-9303] Decimal should use java.math.Decimal directly instead of via Scala wrapper

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: SQL
• Sprint: Spark 1.5 release
• Assignee: Unassigned
• Reporter: Josh Rosen
• Created: 24/Jul/15 06:00
• Updated: 07/Aug/15 03:47
• Resolved: 29/Jul/15 05:52

Description

Spark SQL's Decimal class should use Java's BigDecimal instead of Scala's, since this removes a layer of object allocation and works around an issue where Scala's BigDecimal.hashCode() can lead to OOMs (see https://issues.scala-lang.org/browse/SI-6173).

Issue Links

• links to: [Github] Pull Request #7635 (JoshRosen)
• links to: [Github] Pull Request #8018 (davies)