Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-56

Handle container requests that request more resources than currently available in the cluster

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.2-alpha, 0.23.3
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      In heterogenous clusters, a simple check at the scheduler to check if the allocation request is within the max allocatable range is not enough.

      If there are large nodes in the cluster which are not available, there may be situations where some allocation requests will never be fulfilled. Need an approach to decide when to invalidate such requests. For application submissions, there will need to be a feedback loop for applications that could not be launched. For running AMs, AllocationResponse may need to augmented with information for invalidated/cancelled container requests.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                hitesh Hitesh Shah
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated: