[SPARK-28024] Incorrect numeric values when out of range

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.2, 2.1.3, 2.2.3, 2.3.4, 2.4.4, 3.0.0
• Component/s: SQL
• Labels: correctness
• Target Version/s: 3.0.0
• Assignee: Unassigned
• Reporter: Yuming Wang
• Created: 12/Jun/19 10:19
• Updated: 15/Jul/23 10:03

Description

For example
Case 1:

select tinyint(128) * tinyint(2); -- 0
select smallint(2147483647) * smallint(2); -- -2
select int(2147483647) * int(2); -- -2
SELECT smallint((-32768)) * smallint(-1); -- -32768

Case 2:

spark-sql> select cast('10e-70' as float), cast('-10e-70' as float);
0.0	-0.0

Case 3:

spark-sql> select cast('10e-400' as double), cast('-10e-400' as double);
0.0	-0.0

Case 4:

spark-sql> select exp(-1.2345678901234E200);
0.0

postgres=# select exp(-1.2345678901234E200);
ERROR:  value overflows numeric format

Issue Links

• is related to: SPARK-44444 Enabled ANSI mode by default
• relates to: SPARK-23179 Support option to throw exception if overflow occurs during Decimal arithmetic
• relates to: SPARK-26218 Throw exception on overflow for integers