[SPARK-36040] Add reference to kubernetes-client's version

• Type: Documentation
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.2
• Fix Version/s: 3.2.0, 3.1.3
• Component/s: Documentation
• Assignee: Leona Yoda
• Reporter: Leona Yoda
• Created: 08/Jul/21 05:56
• Updated: 18/Jul/21 21:28
• Resolved: 18/Jul/21 21:28

Description

Running Spark on Kubernetes potentially has upper limitation of Kubernetes version.

Compatibility Matrix

e.g. Spark 3.1.2 uses kubernetes-client 4.12.0 and that does not support Kubernetes >= 1.19.1

I think it is better for users to notice it because Kubernetes update speed is so fast that users tends to run Spark Jobs on unsupported version.

Issue Links

• links to: [Github] Pull Request #33255 (yoda-mon)
• links to: [Github] Pull Request #33255 (yoda-mon)