[SPARK-29651] Incorrect parsing of interval seconds fraction

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.1.0, 2.2.0, 2.3.0, 2.4.0
• Fix Version/s: 2.4.5, 3.0.0
• Component/s: SQL
• Labels: correctness
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 30/Oct/19 07:47
• Updated: 08/Nov/19 03:53
• Resolved: 31/Oct/19 01:22

Description

• The fractional part of interval seconds unit is incorrectly parsed if the number of digits is less than 9, for example:

  spark-sql> select interval '10.123456 seconds';
  interval 10 seconds 123 microseconds
  

  The result must be interval 10 seconds 123 milliseconds 456 microseconds

• If the seconds unit of an interval is negative, it is incorrectly converted to `CalendarInterval`, for example:

  spark-sql> select interval '-10.123456789 seconds';
  interval -9 seconds -876 milliseconds -544 microseconds
  

  Taking into account truncation to microseconds, the result must be interval -10 seconds -123 milliseconds -456 microseconds

Issue Links

• links to: GitHub Pull Request #26313
• links to: GitHub Pull Request #26355