Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12548

Read s3a creds from a Credential Provider

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • fs/s3
    • None
    • Reviewed
    • The S3A Hadoop-compatible file system now support reading its S3 credentials from the Hadoop Credential Provider API in addition to XML configuration files.

    Description

      It would be good if we could read s3 creds from a source other than via a java property/Hadoop configuration option

      Attachments

        1. CredentialProviderAPIforS3FS-002.pdf
          143 kB
          Larry McCay
        2. HADOOP-12548-01.patch
          10 kB
          Larry McCay
        3. HADOOP-12548-02.patch
          10 kB
          Larry McCay
        4. HADOOP-12548-03.patch
          13 kB
          Larry McCay
        5. HADOOP-12548-04.patch
          13 kB
          Larry McCay
        6. HADOOP-12548-05.patch
          13 kB
          Larry McCay
        7. HADOOP-12548-06.patch
          18 kB
          Larry McCay
        8. HADOOP-12548-07.patch
          19 kB
          Larry McCay
        9. HADOOP-12548-branch-2.07.patch
          20 kB
          Chris Nauroth

        Issue Links

        is related to

        Sub-task - The sub-task of the issue HADOOP-12804 Read Proxy Password from Credential Providers in S3 FileSystem

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-12846 Credential Provider Recursive Dependencies

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12555 WASB to read credentials from a credential provider

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12554 Swift client to read credentials from a credential provider

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Patch Available
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-13956 Read ADLS credentials from Credential Provider

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11031 Design Document for Credential Provider API

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            lmccay Larry McCay
            aw Allen Wittenauer
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment