[DRILL-6381] Add capability to do index based planning and execution

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Execution - Relational Operators, Query Planning & Optimization
• Labels: doc-complete ready-to-commit
• Assignee: Aman Sinha
• Reporter: Aman Sinha
• Reviewer: Vitalii Diravka
• Created: 03/May/18 00:29
• Updated: 19/Apr/19 16:22
• Resolved: 26/Oct/18 03:38

Description

If the underlying data source supports indexes (primary and secondary indexes), Drill should leverage those during planning and execution in order to improve query performance.  

On the planning side, Drill planner should be enhanced to provide an abstraction layer which express the index metadata and statistics.  Further, a cost-based index selection is needed to decide which index(es) are suitable.  

On the execution side, appropriate operator enhancements would be needed to handle different categories of indexes such as covering, non-covering indexes, taking into consideration the index data may not be co-located with the primary table, i.e a global index.

Issue Links

• causes: DRILL-6822 Fix imports for DRILL-6381
• relates to: DRILL-3929 Support the ability to query database tables using external indices
• links to: GitHub Pull Request #1466
• links to: GitHub Pull Request #1512
• links to: GitHub Pull Request #1516