Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1032

If Yarn app fails before registering, app master stays around long after

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.9.1, 1.0.0
    • Component/s: YARN
    • Labels:
      None

      Description

      My Spark/YARN app hit an error while initializing its SparkContext (YARN-1031). The app stayed around for another 5 minutes continually logging "14/01/18 23:58:59 INFO impl.AMRMClientImpl: Waiting for application to be successfully unregistered." until YARN finally killed it. This is probably because it died before registering in the first place, but still tried to unregister.

        Attachments

          Activity

            People

            • Assignee:
              sandyr Sandy Ryza
              Reporter:
              sandy Sanford Ryza
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: