[SPARK-31654] sequence producing inconsistent intervals for month step

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 2.4.4
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Roman Yalki
• Created: 06/May/20 23:41
• Updated: 04/Sep/20 06:58
• Resolved: 10/May/20 06:16

Description

Taking an example from https://spark.apache.org/docs/latest/api/sql/

> SELECT sequence(to_date('2018-01-01'), to_date('2018-03-01'), interval 1 month);

[2018-01-01,2018-02-01,2018-03-01]

if one is to expand `stop` till the end of the year some intervals are returned as the last day of the month whereas first day of the month is expected

> SELECT sequence(to_date('2018-01-01'), to_date('2019-01-01'), interval 1 month)

[2018-01-01, 2018-02-01, 2018-03-01, *2018-03-31, 2018-04-30, 2018-05-31, 2018-06-30, 2018-07-31, 2018-08-31, 2018-09-30, 2018-10-31*, 2018-12-01, 2019-01-01]