[BEAM-10216] SESSION TVF Optimizations

• Type: Improvement
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: dsl-sql-zetasql
• Assignee: Unassigned
• Reporter: Rui Wang
• Created: 09/Jun/20 00:12
• Updated: 04/Jun/22 16:37

Description

Current TVF Session has the following limitation:

Use a "dummy" key to go through a GBK to compute window_start and window_end. This introduces an extra shuffle so it costs more.

One optimizations we can do is always merge TableFunctionScanRel with AggregationRel (and also all Join Rel), thus we can use only one GBK to compute both SESSION window_start and window_end, and aggregations(joins).