Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-576

Unknown YARN state RUNNING for app with final status SUCCEEDED

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.5.0
    • 0.7.0
    • Server
    • None

    Description

      Livy with Spark 2.3/2.4 on Yarn 2.9, there is a chance for Yarn to return application reports with Yarn state RUNNING and final Yarn status SUCCEEDED, this means the Yarn application is finishing up and about to be successful. Livy's mapYarnSate() method does not have a valid mapping for this combination and therefore it render the session 'dead'.

      I saw this in Livy server log:

      19/03/25 20:04:28 ERROR utils.SparkYarnApp: Unknown YARN state RUNNING for app application_1553542555261_0063 with final status SUCCEEDED.

      Attachments

        1. LIVY-576.patch
          0.9 kB
          shanyu zhao

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. LIVY-642 A rare status happened in yarn cause SparkApp change into error state

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              shanyu shanyu zhao
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: