Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 2.9.0
    • Labels:
      None

      Description

      YARN-2022 adds a flag in RMContainer to indicate whether the container is an AM or not to skip pre-emption of AM containers. This JIRA proposes propagating this information to NMs as it's required by the AMRMProxy (YARN-2884/YARN-3666) to identify if the container is an AM for:
      1) Security - for authorizing only AMs to communicate with RMs. For e.g.: this is useful to prevent DDos attacks by all containers of a malicious app.
      2) Federation - to allow for transparently spanning an app across multiple sub-clusters

        Issue Links

          Activity

          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          We usually close the newly filed JIRAs as dups.

          I am closing this as dup of YARN-3116 and assigning that to Giovanni Matteo Fumarola.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - We usually close the newly filed JIRAs as dups. I am closing this as dup of YARN-3116 and assigning that to Giovanni Matteo Fumarola .
          Hide
          zjshen Zhijie Shen added a comment -

          Sure, please go ahead. I can help to review the patch here. Will close that one as duplicate

          Show
          zjshen Zhijie Shen added a comment - Sure, please go ahead. I can help to review the patch here. Will close that one as duplicate
          Hide
          giovanni.fumarola Giovanni Matteo Fumarola added a comment -

          Thanks Zhijie Shen for pointing this out. It is indeed a duplicate as we both need a flag to identify the AM container but for different reasons . Are you planning to work on it soon? If not I have a patch that I am presently testing with Subru Krishnanand I can go ahead and submit the patch. The patch is fairly straightforward so it'll be great if you can review it.

          Show
          giovanni.fumarola Giovanni Matteo Fumarola added a comment - Thanks Zhijie Shen for pointing this out. It is indeed a duplicate as we both need a flag to identify the AM container but for different reasons . Are you planning to work on it soon? If not I have a patch that I am presently testing with Subru Krishnan and I can go ahead and submit the patch. The patch is fairly straightforward so it'll be great if you can review it.
          Hide
          zjshen Zhijie Shen added a comment - - edited

          It seems to be duplicate with YARN-3116

          We want to do the same thing, but for the other purpose: triggering the timeline collector only on for the AM container on NM.

          Show
          zjshen Zhijie Shen added a comment - - edited It seems to be duplicate with YARN-3116 We want to do the same thing, but for the other purpose: triggering the timeline collector only on for the AM container on NM.

            People

            • Assignee:
              giovanni.fumarola Giovanni Matteo Fumarola
              Reporter:
              subru Subru Krishnan
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development