[FLINK-8431] Allow to specify # GPUs for TaskManager in Mesos

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: Deployment / Mesos, Runtime / Coordination
• Assignee: Dongwon Kim
• Reporter: Dongwon Kim
• Created: 13/Jan/18 11:24
• Updated: 28/Feb/19 14:12
• Resolved: 30/Jan/18 13:10

Description

Mesos provides first-class support for Nvidia GPUs [1], but Flink does not exploit it when scheduling TaskManagers. If Mesos agents are configured to isolate GPUs as shown in [2], TaskManagers that do not specify to use GPUs cannot see GPUs at all.

We, therefore, need to introduce a new configuration property named "mesos.resourcemanager.tasks.gpus" to allow users to specify # of GPUs for each TaskManager process in Mesos.

[1] http://mesos.apache.org/documentation/latest/gpu-support/
[2] http://mesos.apache.org/documentation/latest/gpu-support/#agent-flags

Issue Links

• links to: GitHub Pull Request #5307