Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19353 Über-jira: S3A Hadoop 3.4.2 features
  3. HADOOP-15603

S3A to support configuring various AWS S3 client extended options

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • None
    • None

    Description

      There's a fair few options in the S3 client connection (IPv4 vs v6, use of accelerated S3...) which we don't configure from fs.s3a options.

      Add them, document them and where possible test them

      Attachments

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HADOOP-17705 S3A to add option fs.s3a.endpoint.region to set AWS region

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HADOOP-16792 Let s3 clients configure request timeout

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-15650 Add custom InstanceProfileCredentialsProvider with more resilience to throttling

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Sub-task - The sub-task of the issue HADOOP-16796 Add AWS S3 Transfer acceleration support

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: