Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-257

NM should gracefully handle a full local disk

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.2-alpha, 0.23.5
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      When a local disk becomes full, the node will fail every container launched on it because the container is unable to localize. It tries to create an app-specific directory for each local and log directories. If any of those directory creates fail (due to lack of free space) the container fails.

      It would be nice if the node could continue to launch containers using the space available on other disks rather than failing all containers trying to launch on the node.

      This is somewhat related to YARN-91 but is centered around the disk becoming full rather than the disk failing.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jlowe Jason Darrell Lowe
              • Votes:
                0 Vote for this issue
                Watchers:
                22 Start watching this issue

                Dates

                • Created:
                  Updated: