Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4984

AM leaves unwanted node/rack requests after container has been assigned

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.0.2-alpha
    • None
    • applicationmaster, mr-am
    • None

    Description

      Consider the following situation:
      node1, node2, and node3 are all on rack1
      task1 is submitted with resource requests on node1, node2, rack1, and *
      task2 is submitted with resource requests on node3, rack1, and *

      The RM gives a container to the app on node1, on which the AM assigns task1. While node1 is removed from the scheduler's bookkeeping, node2 is not, so its delay scheduling will try as hard to assign a container there is it would to node3.

      The AM should cancel its request for node2 on its next heartbeat by sending a resource request with # containers = 0.

      Attachments

        Issue Links

          Activity

            People

              sandyr Sandy Ryza
              sandyr Sandy Ryza
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: