[FLINK-17407] Introduce external resource framework.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Runtime / Configuration, Runtime / Coordination, Runtime / Task
• Labels: pull-request-available
• Assignee: Yangze Guo
• Reporter: Yangze Guo
• Created: 27/Apr/20 09:15
• Updated: 16/Oct/20 10:35
• Resolved: 17/May/20 19:59

Description

• Introduce ExternalResourceDriver, ExternalResourceDriverFactory and ExternalResourceInfo interface.
• Introduce relevant config options.
• Forward external resource requirement to Yarn/K8s
• Instantiate ExternalResourceDrivers in TaskExecutor.
• Enable operator to get ExternalResourceInfo from RuntimeContext.

Issue Links

• relates to: FLINK-15666 GPU scheduling support in Kubernetes mode
• links to: GitHub Pull Request #11854
• links to: GitHub Pull Request #11854