Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9708

Add Yarnclient#getDelegationToken API implementation and SecureLogin in router

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.1.1
    • Fix Version/s: None
    • Component/s: router
    • Labels:
      None
    • Target Version/s:
    • Flags:
      Patch

      Description

      1.we use router as proxy to manage multiple cluster which be independent of each other in order to apply unified client. Thus, we implement our customized AMRMProxyPolicy that doesn't broadcast ResourceRequest to other cluster.

      2.Our production environment need kerberos. But router doesn't support SecureLogin for now.
      https://issues.apache.org/jira/browse/YARN-6539 desn't work. So we improvement it.

      3.Some framework like oozie would get Token via yarnclient#getDelegationToken which router doesn't support. Our solution is that adding homeCluster to ApplicationSubmissionContextProto & GetDelegationTokenRequestProto. Job would be submitted with specified clusterid so that router knows which cluster to submit this job. Router would get Token from one RM according to specified clusterid when client call getDelegation meanwhile apply some mechanism to save this token in memory.

       

        Attachments

          Activity

            People

            • Assignee:
              yifan.stan Xie YiFan
              Reporter:
              yifan.stan Xie YiFan
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: