[FLINK-15632] Zookeeper HA service could not work for active kubernetes integration

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: Deployment / Kubernetes
• Labels: pull-request-available
• Assignee: Yang Wang
• Reporter: Yang Wang
• Created: 17/Jan/20 10:19
• Updated: 22/Jan/20 03:56
• Resolved: 22/Jan/20 03:56

Description

It will be some different, if we want to support HA for active Kubernetes integration.

1. The K8s service is designed for accessing the jobmanager out of K8s cluster. So Flink client will not use HA service to retrieve address of jobmanager. Instead, it always use Kubernetes service to contact with jobmanager via rest client. 
2. The Kubernetes DNS creates A and SRV records only for Services. It doesn't generate pods' A records. So the ip address, not hostname, will be used as jobmanager address.

 

All other behaviors will be same as Zookeeper HA for standalone and Yarn.

To fix this problem, we just need some minor changes to KubernetesClusterDescriptor and KubernetesSessionEntrypoint.

Issue Links

• links to: GitHub Pull Request #10898