Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Now it's not possible to distinguish between two states - SparkApp.State.KILLED and SparkApp.State.FAILED. In both cases the session state will be SessionState.Dead().
In our use case it's important to distinguish whether job was failed or killed. So, I propose to add new SessionState.Killed() which will be used when job was actually killed by user.
If this idea will be approved then I can submit PR about that.