Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5888

Failed job leaves hung AM after it unregisters

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.5.0
    • mr-am
    • None

    Description

      When a job fails the AM hangs during shutdown. A non-daemon thread pool executor thread prevents the JVM teardown from completing, and the AM lingers on the cluster for the AM expiry interval in the FINISHING state until eventually the RM expires it and kills the container. If application limits on the queue are relatively low (e.g.: small queue or small cluster) this can cause unnecessary delays in resource scheduling on the cluster.

      Attachments

        1. MAPREDUCE-5888.patch
          2 kB
          Jason Darrell Lowe

        Issue Links

          is broken by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5317 Stale files left behind for failed jobs

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. YARN-2283 RM failed to release the AM container

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              jlowe Jason Darrell Lowe
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: