[SPARK-30707] Lead/Lag window function throws AnalysisException without ORDER BY clause

• Type: Sub-task
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Jiaan Geng
• Created: 03/Feb/20 07:56
• Updated: 30/Jun/21 17:24

Description

 Lead/Lag window function throws AnalysisException without ORDER BY clause:

SELECT lead(ten, four + 1) OVER (PARTITION BY four), ten, four
FROM (SELECT * FROM tenk1 WHERE unique2 < 10 ORDER BY four, ten)s
org.apache.spark.sql.AnalysisException
Window function lead(ten#x, (four#x + 1), null) requires window to be ordered, please add ORDER BY clause. For example SELECT lead(ten#x, (four#x + 1), null)(value_expr) OVER (PARTITION BY window_partition ORDER BY window_ordering) from table;

 

Maybe we need fix this issue.

Issue Links

• is duplicated by: SPARK-31512 make window function using order by optional
• links to: GitHub Pull Request #27861