Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12846

Credential Provider Recursive Dependencies


    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
    • Target Version/s:
    • Hadoop Flags:


      There are a few credential provider integration points in which the use of a certain type of provider in a certain filesystem causes a recursive infinite loop.

      For instance, a component such as sqoop can be protecting a db password in a credential provider within the wasb/azure filesystem. Now that HADOOP-12555 has introduced the ability to protect the access keys for wasb we suddenly need access to wasb to get the database keys which initiates the attempt to get the access keys from wasb - since there is a provider path configured for sqoop.

      For such integrations, those in which it doesn't make sense to protect the access keys inside the thing that we need the keys to access, we need a solution to avoid this recursion - other than dictating what filesystems can be used by other components.

      This patch proposes the ability to scrub the configured provider path of any provider types that would be incompatible with the integration point. In other words, before calling Configuration.getPassword for the access keys to wasb, we can remove any configured providers that require access to wasb.

      This will require some regex expressions that can be used to identify the configuration of such provider uri's within the provider path parameter.


        1. HADOOP-12846-001.patch
          8 kB
          Larry McCay
        2. HADOOP-12846-002.patch
          8 kB
          Larry McCay
        3. HADOOP-12846-003.patch
          8 kB
          Larry McCay
        4. HADOOP-12846-004.patch
          8 kB
          Larry McCay

          Issue Links



              • Assignee:
                lmccay Larry McCay
                lmccay Larry McCay
              • Votes:
                0 Vote for this issue
                4 Start watching this issue


                • Created: