[DRILL-6561] Lateral excluding the columns from output container provided by projection push into rules

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Component/s: Execution - Relational Operators
• Labels: ready-to-commit
• Assignee: Sorabh Hamirwasia
• Reporter: Sorabh Hamirwasia
• Reviewer: Parth Chandra
• Created: 29/Jun/18 17:27
• Updated: 02/Jul/18 23:10
• Resolved: 02/Jul/18 23:10

Description

With DRILL-6545, LateralPop will have information about list of columns to be excluded from the Lateral output container. Mostly this is used to avoid producing origin repeated column in Lateral output if it's not required from the projection list. This is needed because in absence of it Lateral has to copy the repeated column N number of times where N is the number of rows in right incoming batch for each left incoming batch row. This copy was very costly both from memory and latency perspective. Hence avoiding it is a must for Lateral-Unnest case.

Issue Links

• links to: GitHub Pull Request #1356