[DRILL-4568] Umbrella: Prepare Drill for Management by YARN, Mesos, etc.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Server
• Assignee: Unassigned
• Reporter: Paul Rogers
• Created: 31/Mar/16 16:28
• Updated: 31/Mar/16 21:48

Description

A project is underway to run Drill under YARN. Drill users also wish to run Drill under Mesos. A variety of improvements are needed to achieve good integration.

This is an overview enhancement to group the several detailed enhancements that we discover along the way.

• Configure startup properties from the command line and/or env. vars.
• Advertise Drill capabilities using ZooKeeper
• Provide config options for all Drill ports.
• Provide either a ZK API for Drill's data or represent data as simple data types.
• And so on.

Sub-Tasks

• Rationalize jar structure to minimize client dependencies: Open
• Advertise Drill-bit ports, status, capabilities in ZooKeeper: Open
• Provide startup config properties for all Drill ports: Open
• ZKClusterCoordinator does not call DrillbitStatusListener.drillbitRegistered for new bits: Closed