Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8511

When AM releases a container, RM removes allocation tags before it is released by NM

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.2.0, 3.1.1
    • Component/s: capacity scheduler
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      User leverages PC with allocation tags to avoid port conflicts between apps, we found sometimes they still get port conflicts. This is a similar issue like YARN-4148. Because RM immediately removes allocation tags once AM#allocate asks to release a container, however container on NM has some delay until it actually gets killed and released the port. We should let RM remove allocation tags AFTER NM confirms the containers are released.

        Attachments

        1. YARN-8511.001.patch
          13 kB
          Weiwei Yang
        2. YARN-8511.002.patch
          18 kB
          Weiwei Yang
        3. YARN-8511.003.patch
          19 kB
          Weiwei Yang
        4. YARN-8511.004.patch
          21 kB
          Weiwei Yang

          Activity

            People

            • Assignee:
              cheersyang Weiwei Yang
              Reporter:
              cheersyang Weiwei Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: