Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8511

When AM releases a container, RM removes allocation tags before it is released by NM

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.2.0, 3.1.1
    • capacity scheduler
    • None
    • Reviewed

    Description

      User leverages PC with allocation tags to avoid port conflicts between apps, we found sometimes they still get port conflicts. This is a similar issue like YARN-4148. Because RM immediately removes allocation tags once AM#allocate asks to release a container, however container on NM has some delay until it actually gets killed and released the port. We should let RM remove allocation tags AFTER NM confirms the containers are released.

      Attachments

        1. YARN-8511.001.patch
          13 kB
          Weiwei Yang
        2. YARN-8511.002.patch
          18 kB
          Weiwei Yang
        3. YARN-8511.003.patch
          19 kB
          Weiwei Yang
        4. YARN-8511.004.patch
          21 kB
          Weiwei Yang

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cheersyang Weiwei Yang
            cheersyang Weiwei Yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment