[FLINK-10130] How to define two hdfs name-node IPs in flink-conf.yaml file

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Component/s: FileSystems
• Assignee: Unassigned
• Reporter: Keshav Lodhi
• Created: 13/Aug/18 09:34
• Updated: 06/Nov/20 13:06
• Resolved: 08/Sep/20 12:07

Description

Hi Team,

Here is, what we are looking for:

• We have  flink HA dockerized cluster with (3 zookeepers, 2 job-managers, 3 task-managers).
• We are using HDFS from the flink to store some data. The problem we are facing is that, we are not able to pass 2 name-node IPs in config. 
• These are the config parameters we want to add two name-node IPs

1.       "state.checkpoints.dir: hdfs://X.X.X.X:9001/flinkdatastorage"
2.       "state.backend.fs.checkpointdir: hdfs://X.X.X.X:9001/flinkdatastorage"
3.       "high-availability.zookeeper.storageDir: hdfs://X.X.X.X:9001/flink/recovery"

Currently we are passing only one name-node IP

Please advise. 

I have attached the sample docker-entrypoint.sh file: 

 

Issue Links

• is duplicated by: FLINK-9960 JobManager can't failover to hdfs with multiple namenodes