[HIVE-6999] Add streaming mode to PTFs

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.0, 0.12.0, 0.13.0
• Fix Version/s: 0.14.0
• Labels: TODOC14
• Assignee: Harish Butani
• Reporter: Harish Butani
• Created: 01/May/14 18:26
• Updated: 13/Nov/14 19:40
• Resolved: 19/May/14 06:44

Description

There are a set of use cases where the Table Function can operate on a Partition row by row or on a subset(window) of rows as it is being streamed to it.

• Windowing has couple of use cases of this:processing of Rank functions, processing of Window Aggregations.
• But this is a generic concept: any analysis that operates on an Ordered partition maybe able to operate in Streaming mode.

This patch introduces streaming mode in PTFs and provides the mechanics to handle PTF chains that contain both modes of PTFs.
Subsequent patches will introduce Streaming mode for Windowing.

Issue Links

• links to: Review Board