Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2473

YARN never cleans up container directories from a full disk

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • 2.4.0
    • None
    • nodemanager
    • None

    Description

      After YARN-1781 when a container ends up filling a local disk the nodemanager will mark it as a bad disk and remove it from the list of good local dirs. When the container eventually completes the files that filled the disk will not be removed because the NM thinks the directory is bad.

      Attachments

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue YARN-90 NodeManager should identify failed disks becoming good again

          • Major - Major loss of function.
          • Closed
          is broken by

          Sub-task - The sub-task of the issue YARN-1781 NM should allow users to specify max disk utilization for local disks

          • Major - Major loss of function.
          • Closed

          Activity

            People

              vvasudev Varun Vasudev
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: