[FLINK-5536] Config option: HA

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: Deployment / Mesos
• Assignee: Stavros Kontopoulos
• Reporter: Eron Wright
• Created: 17/Jan/17 19:42
• Updated: 29/Mar/19 11:28
• Resolved: 29/Mar/19 11:28

Description

Configure Flink HA thru package options plus good defaults. The main components are ZK configuration and state backend configuration.

• The ZK information can be defaulted to `master.mesos` as with other packages
• Evaluate whether ZK can be fully configured by default, even if a state backend isn't configured.
• Use DCOS HDFS as the filesystem for the state backend. Evaluate whether to assume that DCOS HDFS is installed by default, or whether to make it explicit.
• To use DCOS HDFS, the init script should download the core-site.xml and hdfs-site.xml from the HDFS 'connection' endpoint. Supply a default value for the endpoint address; see https://docs.mesosphere.com/service-docs/hdfs/connecting-clients/.