Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-688

Containers not cleaned up when NM received SHUTDOWN event from NodeStatusUpdater

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0-beta
    • None
    • None
    • Reviewed

    Description

      Currently, both SHUTDOWN event from nodeStatusUpdater and CleanupContainers event happens to be on the same dispatcher thread, CleanupContainers Event will not be processed until SHUTDOWN event is processed. see similar problem on YARN-495.
      On normal NM shutdown, this is not a problem since normal stop happens on shutdownHook thread.

      Attachments

        1. YARN-688.1.patch
          6 kB
          Jian He
        2. YARN-688-2.0.5-alpha.patch
          3 kB
          Jian He
        3. YARN-688.2.patch
          8 kB
          Jian He
        4. YARN-688.3.patch
          8 kB
          Jian He
        5. YARN-688.4.patch
          8 kB
          Jian He
        6. YARN-688.5.patch
          9 kB
          Jian He
        7. YARN-688.6.patch
          11 kB
          Jian He

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. YARN-864 YARN NM leaking containers with CGroups

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-495 Change NM behavior of reboot to resync

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jianhe Jian He
              jianhe Jian He
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: