[SPARK-16837] TimeWindow incorrectly drops slideDuration in constructors

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.1, 2.1.0
• Component/s: SQL
• Labels: correctness
• Assignee: Tom Magrino
• Reporter: Tom Magrino
• Created: 01/Aug/16 17:27
• Updated: 31/Aug/16 21:37
• Resolved: 02/Aug/16 16:16

Description

Right now, the constructors for the TimeWindow expression in Catalyst incorrectly uses the windowDuration in place of the slideDuration. This will cause incorrect windowing semantics after time window expressions are analyzed by Catalyst.

Relevant code is here: https://github.com/apache/spark/blob/branch-2.0/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala#L29-L54

Issue Links

• links to: [Github] Pull Request #14441 (tmagrino)