Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1032

If Yarn app fails before registering, app master stays around long after

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.1, 1.0.0
    • YARN
    • None

    Description

      My Spark/YARN app hit an error while initializing its SparkContext (YARN-1031). The app stayed around for another 5 minutes continually logging "14/01/18 23:58:59 INFO impl.AMRMClientImpl: Waiting for application to be successfully unregistered." until YARN finally killed it. This is probably because it died before registering in the first place, but still tried to unregister.

      Attachments

        Activity

          People

            sandyr Sandy Ryza
            sandy Sanford Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: