[DRILL-7026] Support Resource Management across queries in Drill

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.16.0
• Fix Version/s: Future
• Component/s: Execution - Flow, Query Planning & Optimization
• Labels: doc-impacting
• Assignee: Sorabh Hamirwasia
• Reporter: Sorabh Hamirwasia
• Created: 04/Feb/19 21:10
• Updated: 26/Feb/19 21:24

Description

Tracks support for Resource Management with dynamic memory requirement across queries using current cluster state. It will also improve multi-tenancy support to configure multiple named queues for a Drill cluster.

Issue Links

• links to: [WIP]: Design Document for Drill Resource Management
• links to: Functional Spec
• links to: RM Overview Slides

Sub-Tasks

• Support for loading and parsing new RM config file: Resolved
• Support memory adjustment framework for resource management with Queues: Resolved
• RM blobs persistence in Zookeeper for Distributed RM: Open
• Integration changes of the Distributed RM queue configuration with Simple Parallelizer.: Open