[FLINK-15790] Make FlinkKubeClient and its implementations asynchronous

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Done
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.1, 1.11.0
• Component/s: Deployment / Kubernetes
• Labels: pull-request-available
• Assignee: Yang Wang
• Reporter: Till Rohrmann
• Created: 28/Jan/20 15:59
• Updated: 16/Apr/20 14:42
• Resolved: 16/Apr/20 14:42

Description

The FlinkKubeClient interface offers several methods which are synchronous (e.g. FlinkKubeClient.createTaskManagerPod, FlinkKubeClient.stopPod, FlinkKubeClient.getPodsWithLabels, etc). The problem is that these methods are directly used by the KubernetesResourceManager which calls them from the main thread. Since these methods perform I/O operations (sending and receiving network packages) they can potentially block the execution and hence should not happen from the RpcEndpoint's main thread.

I propose to make all potentially blocking operations on the FlinkKubeClient asynchronous so that the KubernetesResourceManager does not risk to block the main thread. Alternatively, we could also introduce a FlinkKubeClientAsync which offers asynchronous operations.

Issue Links

• links to: GitHub Pull Request #11427
• links to: GitHub Pull Request #11733