[YUNIKORN-2830] Upgrade kubernetes build dependency to 1.31.0

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: shim - kubernetes
• Labels: pull-request-available
• Target Version: 1.6.0
• Assignee: Craig Condit
• Reporter: Craig Condit
• Created: 22/Aug/24 17:31
• Updated: 24/Oct/24 17:37
• Resolved: 27/Aug/24 20:27

Description

Now that Kubernetes 1.31 has been released, we should update our build dependency. Currently we compile against 1.29, which means any updates in functionality of scheduler plugins are not being utilized.

Issue Links

• is related to: SPARK-50099 Update `YuniKorn` docs with 1.6.0
• links to: GitHub Pull Request #898