[HIVE-896] Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: OLAP, UDF
• Assignee: Harish Butani
• Reporter: Amr Awadallah
• Created: 21/Oct/09 21:54
• Updated: 29/Jan/14 12:08
• Resolved: 02/Apr/13 15:17

Description

Windowing functions are very useful for click stream processing and similar time-series/sliding-window analytics.

More details at:

http://download-west.oracle.com/docs/cd/B13789_01/server.101/b10736/analysis.htm#i1006709
http://download-west.oracle.com/docs/cd/B13789_01/server.101/b10736/analysis.htm#i1007059
http://download-west.oracle.com/docs/cd/B13789_01/server.101/b10736/analysis.htm#i1007032

– amr

Issue Links

• relates to: HIVE-4197 Bring windowing support inline with SQL Standard
• relates to: HIVE-1304 add row_sequence UDF
• requires: HIVE-4037 Merge a PTFOp for PTF invocation and a PTFOp for Windowing if possible
• requires: HIVE-3984 Maintain a clear separation between Windowing & PTF at the specification level.
• requires: HIVE-3985 Update new UDAFs introduced for Windowing to work with new Decimal Type
• requires: HIVE-3986 Fix select expr processing in PTF Operator
• requires: HIVE-3987 Update PTF invocation and windowing grammar
• requires: HIVE-4028 Bring paranthesis handling in windowing specification in compliance with sql standard
• requires: HIVE-4030 Name windowing function in consistence with sql standard
• requires: HIVE-4034 Should be able to specify windowing spec without needing Between
• requires: HIVE-4035 Column Pruner for PTF Op
• requires: HIVE-4036 remove use of FunctionRegistry during PTF Op initialization
• requires: HIVE-4041 Support multiple partitionings in a single Query
• requires: HIVE-4052 Disallow partition/sort and distribute/order combinations in windowing and partitioning spec
• requires: HIVE-4080 Add Lead & Lag UDAFs
• requires: HIVE-4081 allow expressions with over clause
• requires: HIVE-4040 fix ptf negative tests
• requires: HIVE-4019 Ability to create and drop temporary partition function
• requires: HIVE-4048 Allow partition by/order by in partitioning spec in over clause and partition function
• requires: HIVE-3981 Split up tests in ptf_general_queries.q
• requires: HIVE-3982 Merge PTFDesc and PTFDef classes
• requires: HIVE-4031 Add apache headers in new files
• supercedes: HIVE-952 Support analytic NTILE function