[SPARK-32018] Fix UnsafeRow set overflowed decimal

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.6, 2.4.7, 3.0.0, 3.0.1
• Fix Version/s: 3.1.0
• Component/s: SQL
• Assignee: Wenchen Fan
• Reporter: Allison Wang
• Created: 17/Jun/20 23:59
• Updated: 18/Aug/20 04:03
• Resolved: 16/Jul/20 18:11

Description

There is a bug that writing an overflowed decimal into UnsafeRow is fine but reading it out will throw ArithmeticException. This exception is thrown when calling getDecimal in UnsafeRow with input decimal's precision greater than the input precision. Setting the value of the overflowed decimal to null when writing into UnsafeRow should fix this issue.

Issue Links

• links to: [Github] Pull Request #29026 (cloud-fan)
• links to: [Github] Pull Request #29026 (cloud-fan)
• links to: [Github] Pull Request #29125 (cloud-fan)
• links to: [Github] Pull Request #29125 (cloud-fan)
• links to: [Github] Pull Request #29141 (cloud-fan)
• links to: [Github] Pull Request #29141 (cloud-fan)
• links to: [Github] Pull Request #29404 (gengliangwang)
• links to: [Github] Pull Request #29404 (gengliangwang)
• links to: [Github] Pull Request #29448 (gengliangwang)
• links to: [Github] Pull Request #29448 (gengliangwang)
• links to: [Github] Pull Request #29450 (gengliangwang)
• links to: [Github] Pull Request #29450 (gengliangwang)
• links to: [Github] Pull Request #29458 (gengliangwang)