Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12537

S3A to support Amazon STS temporary credentials

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.7.1
    • 2.8.0, 3.0.0-alpha1
    • fs/s3
    • None
    • S3A now supports use of AWS Security Token Service temporary credentials for authentication to S3. Refer to the documentation of configuration property fs.s3a.session.token for further details.

    Description

      Amazon STS allows you to issue temporary access key id / secret key pairs for your a user / role. However, using these credentials also requires specifying a session ID. There is currently no such configuration property or the required code to pass it through to the API (at least not that I can find) in any of the S3 connectors.

      Attachments

        1. HADOOP-12537-branch-2.007.patch
          19 kB
          Steve Loughran
        2. HADOOP-12537.006.patch
          19 kB
          Sean Mackrory
        3. HADOOP-12537-branch-2.005.patch
          19 kB
          Steve Loughran
        4. HADOOP-12537.004.patch
          14 kB
          Sean Mackrory
        5. HADOOP-12537.003.patch
          6 kB
          Sean Mackrory
        6. HADOOP-12537.002.patch
          14 kB
          Sean Mackrory
        7. HADOOP-12537.001.patch
          13 kB
          Sean Mackrory
        8. HADOOP-12537.diff
          10 kB
          Sean Mackrory
        9. HADOOP-12537.diff
          10 kB
          Sean Mackrory

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HADOOP-13078 switch hadoop-aws back to using the (heavy) amazon-sdk JAR

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12632 Allow S3A to use Temporary Credentials for Auth

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-13277 Need To Support IAM role based access for supporting Amazon S3

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9680 Extend S3FS and S3NativeFS to work with AWS IAM Temporary Security Credentials

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-13313 S3A TemporaryAWSCredentialsProvider to support Hadoop Credential providers for secrets

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              mackrorysd Sean Mackrory
              mackrorysd Sean Mackrory
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: