[YUNIKORN-643] Improve the spark-k8s-operator app mgmt plugin to better handle Spark CRDs

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11
• Component/s: shim - kubernetes
• Labels: pull-request-available
• Assignee: Chaoran Yu
• Reporter: Weiwei Yang
• Created: 15/Apr/21 04:44
• Updated: 21/Jan/22 21:48
• Resolved: 16/Apr/21 07:46

Description

The current spark operator plugin watches the events from both pods and spark CRDs, this causes some conflicts while handling applications. This task is to simplify the plugin to handle a minimal set of work and react only to the spark CRD events. This can avoid conflicts and simplify the logic.

Issue Links

• links to: GitHub Pull Request #253