Hadoop YARN
  1. Hadoop YARN
  2. YARN-180

Capacity scheduler - containers that get reserved create container token to early

    Details

      Description

      The capacity scheduler has the ability to 'reserve' containers. Unfortunately before it decides that it goes to reserved rather then assigned, the Container object is created which creates a container token that expires in roughly 10 minutes by default.

      This means that by the time the NM frees up enough space on that node for the container to move to assigned the container token may have expired.

      1. YARN-180.patch
        3 kB
        Arun C Murthy
      2. YARN-180.patch
        3 kB
        Arun C Murthy
      3. YARN-180.patch
        3 kB
        Robert Joseph Evans
      4. YARN-180-branch_0.23.patch
        3 kB
        Thomas Graves

        Issue Links

          Activity

          Thomas Graves created issue -
          Arun C Murthy made changes -
          Field Original Value New Value
          Assignee Arun C Murthy [ acmurthy ]
          Thomas Graves made changes -
          Description The capacity scheduler has the ability to 'reserve' containers. Unfortunately before it decides that it goes to reserved rather then assigned, the Container object is created which creates a container token that expires in roughly 10 minutes by default.

          This means that by the time the NM frees up enough space on that node for the container to move to assigned the container token will most likely have expired.
          The capacity scheduler has the ability to 'reserve' containers. Unfortunately before it decides that it goes to reserved rather then assigned, the Container object is created which creates a container token that expires in roughly 10 minutes by default.

          This means that by the time the NM frees up enough space on that node for the container to move to assigned the container token may have expired.
          Arun C Murthy made changes -
          Attachment YARN-180.patch [ 12550355 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 2.0.3-alpha [ 12323272 ]
          Fix Version/s 0.23.5 [ 12323311 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Arun C Murthy made changes -
          Attachment YARN-180.patch [ 12550507 ]
          Robert Joseph Evans made changes -
          Attachment YARN-180.patch [ 12550518 ]
          Robert Joseph Evans made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Attachment YARN-180-branch_0.23.patch [ 12550520 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 3.0.0 [ 12323268 ]
          Resolution Fixed [ 1 ]
          Thomas Graves made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue relates to YARN-1417 [ YARN-1417 ]
          Allen Wittenauer made changes -
          Fix Version/s 3.0.0 [ 12323268 ]

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development