Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-257

NM should gracefully handle a full local disk

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.0.2-alpha, 0.23.5
    • None
    • nodemanager
    • None

    Description

      When a local disk becomes full, the node will fail every container launched on it because the container is unable to localize. It tries to create an app-specific directory for each local and log directories. If any of those directory creates fail (due to lack of free space) the container fails.

      It would be nice if the node could continue to launch containers using the space available on other disks rather than failing all containers trying to launch on the node.

      This is somewhat related to YARN-91 but is centered around the disk becoming full rather than the disk failing.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated: