[DRILL-6503] Performance improvements in lateral

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Component/s: Execution - Relational Operators
• Labels: ready-to-commit
• Assignee: Sorabh Hamirwasia
• Reporter: Sorabh Hamirwasia
• Reviewer: Parth Chandra
• Created: 15/Jun/18 22:36
• Updated: 27/Jun/18 06:20
• Resolved: 27/Jun/18 06:20

Description

In LateralJoin currently the copying of data from left and right inputs is not very efficient. Basically for the number of rows seen in right side (let say n), it does copy row by row across all vectors in left and right inputs. Whereas if it copies each vectors (n times) and then move to next vector that can help in improving the performance.

Also today MemoryManager::update can be called in lateral multiple times for left and right incoming. These calls are found to be very expensive hence make sure it's called only once for every new incoming  from both left and right.

Issue Links

• is depended upon by: DRILL-5999 Add support for LATERAL join
• links to: GitHub Pull Request #1328