[SPARK-26585] [K8S] Add additional integration tests for K8s Scheduler Backend

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0
• Component/s: Kubernetes, Spark Core
• Assignee: Unassigned
• Reporter: Nagaram Prasad Addepally
• Created: 10/Jan/19 03:01
• Updated: 17/May/20 18:24
• Resolved: 11/Jan/19 19:43

Description

I have reviewed the kubernetes integration tests and found out that following cases are missing for testing scheduler backend functionality. 

• Run application with driver and executor image specified independently
• Request Pods with custom CPU and Limits
• Request Pods with custom Memory and memory overhead factor
• Request Pods with custom Memory and memory overhead
• Pods are relaunched on failures (as per spark.kubernetes.executor.lostCheck.maxAttempts)

Logging this Jira to add these tests

Issue Links

• links to: GitHub Pull Request #23504