[YUNIKORN-1699] Support Kubernetes 1.27

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: shim - kubernetes
• Labels: pull-request-available release-notes
• Target Version: 1.4.0
• Assignee: Craig Condit
• Reporter: Craig Condit
• Created: 18/Apr/23 19:22
• Updated: 20/Nov/23 16:42
• Resolved: 28/Jun/23 01:02

Description

The scheduler plugin mode doesn't work when running under Kubernetes 1.27, as the v1beta1 version of CSIStorageCapacity was removed from the API server. This prevents the plugin from starting up as the informers won't sync, and scheduling is non-functional.

As v1 was not available until 1.24, so we will need to build against at least 1.24. However, this will remove compatibility for running on 1.21 through 1.23. This is tricky, as 1.22 and especially 1.23 are still widely deployed.

See https://issues.apache.org/jira/browse/YUNIKORN-1196?focusedCommentId=17531921&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17531921 for breaking changes in the API server identified the last time we upgraded our dependency on Kubernetes.

Opening this now to drive visibility and facilitate discussion.

Issue Links

• is related to: YUNIKORN-1196 Upgrade K8s shim build dependency to 1.23.12
• is related to: YUNIKORN-1894 k8s.gcr.io Redirect to registry.k8s.io
• links to: GitHub Pull Request #610