[SPARK-28308] CalendarInterval sub-second part should be padded before parsing

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.2, 2.1.3, 2.2.3, 2.3.3, 2.4.3
• Fix Version/s: 2.3.4, 2.4.4, 3.0.0
• Component/s: Spark Core
• Labels: correctness
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 08/Jul/19 23:16
• Updated: 09/Jul/19 06:19
• Resolved: 09/Jul/19 06:18

Description

spark-sql> select interval '0 0:0:0.123456789' day to second;
interval 123 milliseconds 456 microseconds

spark-sql> select interval '0 0:0:0.12345678' day to second;
interval 12 milliseconds 345 microseconds

spark-sql> select interval '0 0:0:0.1234' day to second;
interval 1 microseconds
Time taken: 0.024 seconds, Fetched 1 row(s)

Issue Links

• links to: GitHub Pull Request #25079