[FLINK-1984] Integrate Flink with Apache Mesos

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: Deployment / Mesos, Runtime / Coordination
• Assignee: Eron Wright
• Reporter: Robert Metzger
• Created: 07/May/15 09:54
• Updated: 28/Feb/19 14:13
• Resolved: 17/Jan/17 19:34

Description

There are some users asking for an integration of Flink into Mesos.

There also is a pending pull request for adding Mesos support for Flink: https://github.com/apache/flink/pull/251

Update (May '16): a new effort is now underway, building on the recent ResourceManager work.

Update (Oct '16): the core functionality is in the master branch. New sub-tasks track remaining work for a first release.

Design document: (google doc)

Issue Links

• relates to: FLINK-2346 Mesos clustering
• relates to: FLINK-3543 Introduce ResourceManager component
• links to: GitHub Pull Request #2315
• links to: GitHub Pull Request #3586

Sub-Tasks

• Implement DCOS package: Closed
• Implement Docker image support: Resolved
• Build DCOS Docker image: Closed
• Upgrade to Mesos 1.0.1: Closed
• Write documentation: Resolved
• Formalize the AppMaster environment for docker compability: Resolved
• Add keytab based kerberos support for Mesos environment: Closed
• Add SSL support to Mesos artifact server: Closed