[SPARK-18555] na.fill miss up original values in long integers

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.0.1, 2.0.2
• Fix Version/s: 2.0.3, 2.1.1, 2.2.0
• Component/s: SQL
• Assignee: Song Jun
• Reporter: Mahmoud Rawas
• Created: 23/Nov/16 03:58
• Updated: 11/Apr/17 00:38
• Resolved: 06/Dec/16 02:39

Description

Manly the issue is clarified in the following example:
Given a Dataset:

scala> data.show

a	b
1	2
-1	-2
9123146099426677101	9123146560113991650

theoretically when we call na.fill(0) nothing should change, while the current result is:

scala> data.na.fill(0).show

a	b
1	2
-1	-2
9123146099426676736	9123146560113991680

Issue Links

• duplicates: SPARK-19375 na.fill() should not change the data type of column
• links to: [Github] Pull Request #15994 (windpiger)
• links to: [Github] Pull Request #17600 (dbtsai)
• links to: [Github] Pull Request #17601 (dbtsai)