Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14831

Über-jira: S3a phase IV: Hadoop 3.1 features

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.1.0
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:

      Description

      All the S3/S3A features targeting Hadoop 3.1

        Attachments

          Issue Links

          1.
          Cut S3AOutputStream Sub-task Resolved Unassigned
          2.
          S3A globber to use bulk listObject call over recursive directory scan Sub-task Resolved Unassigned
          3.
          S3A delete and rename may fail to preserve parent directory. Sub-task Resolved Unassigned
          4.
          s3a home directory to be "/" Sub-task Resolved Unassigned
          5.
          ITestS3AContractRootDir.testRmEmptyRootDirNonRecursive failing intermittently Sub-task Resolved Unassigned
          6.
          S3AInputStream to implement an efficient skip() call through seeking Sub-task Resolved Unassigned
          7.
          Intermittent failure of TestS3AContractRootDir.testListEmptyRootDirectory Sub-task Resolved Unassigned
          8.
          extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret.key Sub-task Resolved Steve Loughran
          9.
          s3a input stream "normal" fadvise mode to be adaptive Sub-task Resolved Steve Loughran
          10.
          S3AInputStream/OutputStream statistics aren't getting into StorageStatistics Sub-task Resolved Unassigned
          11.
          [s3a] Log StorageStatistics Sub-task Resolved Sean Mackrory
          12.
          error message in S3AUtils.getServerSideEncryptionKey() needs to expand property constant Sub-task Resolved Chen Liang
          13.
          reinstate URI parameter in AWSCredentialProvider constructors Sub-task Resolved Steve Loughran
          14.
          S3 blob etags to be made visible in S3A status/getFileChecksum() calls Sub-task Resolved Steve Loughran
          15.
          Metrics of S3A don't print out when enable it in Hadoop metrics property file Sub-task Resolved Yonger
          16.
          s3a troubleshooting docs to add a couple more failure modes Sub-task Resolved Steve Loughran
          17.
          Enhance S3A troubleshooting documents and add a performance document Sub-task Resolved Steve Loughran
          18.
          S3Guard CLI to support list/purge of pending multipart commits Sub-task Resolved Aaron Fabbri
          19.
          NPE in S3A getFileStatus: null instrumentation on using closed instance Sub-task Resolved Steve Loughran
          20.
          Support IAM Assumed roles in S3A Sub-task Resolved Steve Loughran
          21.
          ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch Sub-task Resolved Steve Loughran
          22.
          s3a: Stream and common statistics missing from metrics Sub-task Resolved Sean Mackrory
          23.
          Enhance IAM Assumed Role support in S3A client Sub-task Resolved Steve Loughran
          24.
          add mapreduce.outputcommitter.factory.scheme.s3a to core-default Sub-task Resolved Unassigned
          25.
          Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation Sub-task Resolved Aaron Fabbri
          26.
          Translate AWS SSE-KMS missing key exception to something Sub-task Resolved Unassigned
          27.
          S3a "Bad Request" message to include diagnostics Sub-task Resolved Unassigned
          28.
          transient failure of ITestCommitOperations.testCommitEmptyFile; fault injection related Sub-task Resolved Unassigned
          29.
          Listing s3a bucket without credentials gives Interrupted error Sub-task Resolved Unassigned
          30.
          S3a committer factory to warn when default FileOutputFormat committer is created Sub-task Resolved Unassigned
          31.
          S3AInputStream to handle reconnect on read() failure better Sub-task Resolved Unassigned
          32.
          AWS "shaded" SDK 1.11.271 is pulling in netty 4.1.17 Sub-task Resolved Steve Loughran
          33.
          S3A multipart upload fails when SSE-C encryption is enabled Sub-task Resolved Anis Elleuch
          34.
          log s3a at info Sub-task Resolved Steve Loughran
          35.
          remove .FluentPropertyBeanIntrospector from CLI operation log output Sub-task Resolved Steve Loughran
          36.
          Make S3A etag => checksum feature optional Sub-task Resolved Steve Loughran

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: