[LIVY-702] Submit Spark apps to Kubernetes

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.9.0
• Environment: Kubernetes
• Epic Link: Spark on Kubernetes support
• Assignee: Unassigned
• Reporter: Aliaksandr Sasnouskikh
• Created: 26/Oct/19 21:41
• Updated: 18/Oct/23 13:39

Description

Provide a way to submit Spark apps to Kubernetes. Points to cover:

• Support Batch sessions
• Support Interactive sessions
• Collect logs and diagnostics information
• Restore sessions monitoring after Livy restarts
• GC created Kubernetes resources