Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5593

Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • applicationmaster
    • None

    Description

      In RMContainerAllocator, AssignMapsWithLocality() is a very important method to assign map tasks on allocated containers with conforming different level of locality (dataLocal, rackLocal, etc.). However, this method messed with different code logic to handle different type of locality but have lots of similar behaviours. This is hard to maintain as well as do extension with other locality type, so we need some more clear code here.

      Attachments

        1. MAPREDUCE-5593-v3.patch
          18 kB
          Junping Du
        2. MAPREDUCE-5593-v4.patch
          18 kB
          Junping Du
        3. YARN-1163-v1.patch
          18 kB
          Junping Du
        4. YARN-1163-v2.patch
          18 kB
          Junping Du

        Issue Links

          Activity

            People

              junping_du Junping Du
              junping_du Junping Du
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: