[SPARK-31520] Add a readiness probe to spark pod definitions

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.4.5
• Component/s: Kubernetes, Spark Core
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Dale Richardson
• Created: 22/Apr/20 11:50
• Updated: 25/May/21 01:55
• Resolved: 25/May/21 01:38

Description

Add a readiness probe to allow so Kubernetes can communicate basic spark pod state to the end user via get/describe pod commands.

A basic TCP/SYN probe of the RPC port should be enough to indicate that a spark process is running.