Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4671

AM does not tell the RM about container requests that are no longer needed

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha
    • Fix Version/s: 0.23.7, 2.1.0-beta
    • Component/s: None
    • Labels:
      None

      Description

      Say the AM wanted a container at hosts h1, h2, h3. After getting a container at h1 it should tell RM that it no longer needs containers at h2, h3. Otherwise on the RM h2, h3 remain valid allocation locations.
      The AM RMContainerAllocator does remove these resource requests internally. When the resource request container count drops to 0 then it drops the resource request from its tables but forgets to send the 0 sized request to the RM.

      1. MAPREDUCE-4671.1.patch
        4 kB
        Bikas Saha
      2. MAPREDUCE-4671.2.patch
        5 kB
        Bikas Saha
      3. MAPREDUCE-4671.3.patch
        7 kB
        Bikas Saha
      4. MAPREDUCE-4671.4.patch
        7 kB
        Bikas Saha
      5. MAPREDUCE-4671.txt
        7 kB
        Siddharth Seth

        Issue Links

          Activity

          Bikas Saha created issue -
          Bikas Saha made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-4671.1.patch [ 12545978 ]
          Bikas Saha made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Karthik Kambatla (Inactive) made changes -
          Link This issue relates to YARN-110 [ YARN-110 ]
          Bikas Saha made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Bikas Saha made changes -
          Attachment MAPREDUCE-4671.2.patch [ 12545987 ]
          Bikas Saha made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Siddharth Seth made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Affects Version/s 2.0.0-alpha [ 12320354 ]
          Affects Version/s 0.23.3 [ 12320060 ]
          Target Version/s 2.0.3-alpha [ 12323275 ]
          Bikas Saha made changes -
          Attachment MAPREDUCE-4671.3.patch [ 12548529 ]
          Bikas Saha made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Bikas Saha made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Bikas Saha made changes -
          Attachment MAPREDUCE-4671.4.patch [ 12551323 ]
          Bikas Saha made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Sandy Ryza made changes -
          Link This issue is duplicated by MAPREDUCE-4984 [ MAPREDUCE-4984 ]
          Siddharth Seth made changes -
          Attachment MAPREDUCE-4671.txt [ 12568374 ]
          Siddharth Seth made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.0.4-beta [ 12324032 ]
          Resolution Fixed [ 1 ]
          Thomas Graves made changes -
          Fix Version/s 0.23.7 [ 12323954 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Bikas Saha
              Reporter:
              Bikas Saha
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development