[SPARK-3587] Spark SQL can't support lead() over() window function

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.2, 1.1.0
• Component/s: SQL

Environment

operator system is suse 11.3, three node ,every node has 48GB MEM and 16 CPU

• Assignee: Unassigned
• Reporter: caoli
• Created: 18/Sep/14 10:05
• Updated: 09/Feb/15 05:56
• Resolved: 09/Feb/15 05:56

Description

When run the following SQL:
"select c.plateno, c.platetype,c.bay_id as start_bay_id,c.pastkkdate as start_time,lead(c.bay_id) over(partition by c.plateno order by c.pastkkdate) as end_bay_id, lead(c.pastkkdate) over(partition by c.plateno order by c.pastkkdate) as end_time from bay_car_test1 c"

----in HIVE, it is OK,

-----but run in Spark SQL with HiveContext, it is error with:

java.lang.RuntimeException:
Unsupported language features in query: select c.plateno, c.platetype,c.bay_id as start_bay_id,c.pastkkdate as start_time,lead(c.bay_id) over(partition by c.plateno order by c.pastkkdate) as end_bay_id, lead(c.pastkkdate) over(partition by c.plateno order by c.pastkkdate) as end_time from bay_car_test1 c
TOK_QUERY

is Spark SQLcan't support lead() and over() function?

Issue Links

• duplicates: SPARK-1442 Add Window function support