Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-576

Unknown YARN state RUNNING for app with final status SUCCEEDED

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.5.0
    • Fix Version/s: None
    • Component/s: Server
    • Labels:
      None

      Description

      Livy with Spark 2.3/2.4 on Yarn 2.9, there is a chance for Yarn to return application reports with Yarn state RUNNING and final Yarn status SUCCEEDED, this means the Yarn application is finishing up and about to be successful. Livy's mapYarnSate() method does not have a valid mapping for this combination and therefore it render the session 'dead'.

      I saw this in Livy server log:

      19/03/25 20:04:28 ERROR utils.SparkYarnApp: Unknown YARN state RUNNING for app application_1553542555261_0063 with final status SUCCEEDED.

        Attachments

        1. LIVY-576.patch
          0.9 kB
          shanyu zhao

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              shanyu shanyu zhao
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: