Description
Livy with Spark 2.3/2.4 on Yarn 2.9, there is a chance for Yarn to return application reports with Yarn state RUNNING and final Yarn status SUCCEEDED, this means the Yarn application is finishing up and about to be successful. Livy's mapYarnSate() method does not have a valid mapping for this combination and therefore it render the session 'dead'.
I saw this in Livy server log:
19/03/25 20:04:28 ERROR utils.SparkYarnApp: Unknown YARN state RUNNING for app application_1553542555261_0063 with final status SUCCEEDED.
Attachments
Attachments
Issue Links
- duplicates
-
LIVY-642 A rare status happened in yarn cause SparkApp change into error state
- Resolved