Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14443

Azure: Support retry and client side failover for authorization, SASKey and delegation token generation

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: fs/azure
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, WasRemoteCallHelper can be configured to talk to only one URL for authorization, SASKey generation and delegation token generation. If for some reason the service is down, all the requests will fail.
      So proposal is to,

      • Add support to configure multiple URLs, so that if communication to one URL fails, client can retry on another instance of the service running on different node for authorization, SASKey generation and delegation token generation.
      • Rename the configurations fs.azure.authorization.remote.service.url to fs.azure.authorization.remote.service.urls and fs.azure.cred.service.url to fs.azure.cred.service.urls to support the comma separated list of URLs.
      • Introduce a new configuration fs.azure.delegation.token.service.urls to configure the comma separated list of service URLs to get the delegation token.

        Attachments

        1. HADOOP-14443.1.patch
          89 kB
          Santhosh G Nayak
        2. HADOOP-14443.2.patch
          97 kB
          Santhosh G Nayak
        3. HADOOP-14443.3.patch
          97 kB
          Santhosh G Nayak
        4. HADOOP-14443.4.patch
          97 kB
          Santhosh G Nayak
        5. HADOOP-14443.5.patch
          101 kB
          Santhosh G Nayak
        6. HADOOP-14443.6.patch
          102 kB
          Mingliang Liu
        7. HADOOP-14443.7.patch
          102 kB
          Mingliang Liu
        8. HADOOP-14443-branch2-1.patch
          100 kB
          Santhosh G Nayak
        9. HADOOP-14443-branch2-2.patch
          101 kB
          Santhosh G Nayak
        10. HADOOP-14443-branch-2.2.patch
          101 kB
          Jitendra Nath Pandey

          Issue Links

            Activity

              People

              • Assignee:
                snayak Santhosh G Nayak
                Reporter:
                snayak Santhosh G Nayak
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: