[FLINK-30313] Flink Kubernetes Operator seems to rely on 1.15 k8s HA code but 1.16 config code

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Cannot Reproduce
• Affects Version/s: kubernetes-operator-1.2.0
• Fix Version/s: kubernetes-operator-1.3.0
• Component/s: Kubernetes Operator
• Assignee: Márton Balassi
• Reporter: Matthias Pohl
• Created: 06/Dec/22 13:40
• Updated: 07/Dec/22 14:56
• Resolved: 07/Dec/22 14:47

Description

Based on this SO post, it looks like there can be a setup where we use different versions of Flink:

2022-11-28 08:57:56.032 [main] INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint  - Shutting KubernetesApplicationClusterEntrypoint down with application status FAILED. Diagnostics java.lang.NoSuchFieldError: USE_OLD_HA_SERVICES
        at org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory.createHAServices(KubernetesHaServicesFactory.java:37)
        at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createCustomHAServices(HighAvailabilityServicesUtils.java:296)
        at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createHighAvailabilityServices(HighAvailabilityServicesUtils.java:139)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.createHaServices(ClusterEntrypoint.java:439)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:382)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:282)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$1(ClusterEntrypoint.java:232)
        at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:229)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:729)
        at org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint.main(KubernetesApplicationClusterEntrypoint.java:86)

This field was removed in FLINK-25806 with Flink 1.16. I'd guess that it's caused by the Flink operator still depending on Flink 1.15.x whilest there is an option to use Flink 1.16 for deployments already.

Another SO user mentioned:

I have the same issue with flink-kubernetes-operator. This field NoSuchFieldError: USE_OLD_HA_SERVICES was removed in flink 1.16, but error occurs with setting: flinkVersion: v1_15

Issue Links

• is caused by: FLINK-25806 Remove legacy high availability services