Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9708

Yarn Router Support DelegationToken

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 3.4.0
    • None
    • router
    • Patch

    Description

      1.we use router as proxy to manage multiple cluster which be independent of each other in order to apply unified client. Thus, we implement our customized AMRMProxyPolicy that doesn't broadcast ResourceRequest to other cluster.

      2.Our production environment need kerberos. But router doesn't support SecureLogin for now.
      https://issues.apache.org/jira/browse/YARN-6539 desn't work. So we improvement it.

      3.Some framework like oozie would get Token via yarnclient#getDelegationToken which router doesn't support. Our solution is that adding homeCluster to ApplicationSubmissionContextProto & GetDelegationTokenRequestProto. Job would be submitted with specified clusterid so that router knows which cluster to submit this job. Router would get Token from one RM according to specified clusterid when client call getDelegation meanwhile apply some mechanism to save this token in memory.

       

      Attachments

        Activity

          People

            slfan1989 fanshilun
            yifan.stan Xie YiFan
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: