[FLINK-10934] Support application mode in kubernetes

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Client / Job Submission, Deployment / Kubernetes
• Labels: pull-request-available
• Assignee: Yang Wang
• Reporter: JIN SUN
• Created: 19/Nov/18 21:47
• Updated: 27/May/20 13:29
• Resolved: 13/May/20 21:01

Description

The Kubernetes do not have a default distributed storage and provide public api to ship files like Yarn local resource. So we could not ship the user jars and files on the client side to jobmanager and taskmanager. Also it is not a common way on Kubernetes. Instead, users usually build their jars and files into the docker image. So when the jobmanager and taskmanager are launched, the users jars already existed.

Even if some users do not want to build the jars into the image, they could use the initContainer to download the jars from the storage(http/s3/etc.).

All in all, the Kubernetes per-job cluster will only support cluster deploy-mode(now called "application mode").

 

This ticket depends on FLIP-85(Support cluster deployment). Please reference the documentation FLIP-85 for more information.

Issue Links

• is blocked by: FLINK-16654 Implement Application Mode according to FLIP-85
• relates to: FLINK-17976 Test native K8s integration
• links to: Flink Application Mode
• links to: GitHub Pull Request #12003
• links to: Support cluster deploy mode