Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5115

MR app master may try to assign a reduce priority container to a map

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      ScheduledRequests.assign() checks reduces.isEmpty() and releases REDUCE priority containers. But it could have received more REDUCE priority containers than reduces.size() in which case it will not release excess REDUCE priority containers. Later on in ScheduledRequests.assignToReduce() it will not be able to assign them to reduces. These containers will fall through to ScheduledRequests.assignMapsWithLocality() where they will get assigned to maps or crash depending on the behavior of Java assert.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: