Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12548

Read s3a creds from a Credential Provider

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • fs/s3
    • None
    • Reviewed
    • The S3A Hadoop-compatible file system now support reading its S3 credentials from the Hadoop Credential Provider API in addition to XML configuration files.

    Description

      It would be good if we could read s3 creds from a source other than via a java property/Hadoop configuration option

      Attachments

        1. CredentialProviderAPIforS3FS-002.pdf
          143 kB
          Larry McCay
        2. HADOOP-12548-01.patch
          10 kB
          Larry McCay
        3. HADOOP-12548-02.patch
          10 kB
          Larry McCay
        4. HADOOP-12548-03.patch
          13 kB
          Larry McCay
        5. HADOOP-12548-04.patch
          13 kB
          Larry McCay
        6. HADOOP-12548-05.patch
          13 kB
          Larry McCay
        7. HADOOP-12548-06.patch
          18 kB
          Larry McCay
        8. HADOOP-12548-07.patch
          19 kB
          Larry McCay
        9. HADOOP-12548-branch-2.07.patch
          20 kB
          Chris Nauroth

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HADOOP-12804 Read Proxy Password from Credential Providers in S3 FileSystem

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-12846 Credential Provider Recursive Dependencies

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12555 WASB to read credentials from a credential provider

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12554 Swift client to read credentials from a credential provider

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-13956 Read ADLS credentials from Credential Provider

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11031 Design Document for Credential Provider API

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lmccay Larry McCay
              aw Allen Wittenauer
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: