Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.5
    • 3.4.1
    • fs/s3
    • None

    Description

      Changes related to s3a in the next branch-3.3 release.
      Presence in this list != any commitment to implement, unless there's active dev

      Attachments

        Issue Links

        1.
        ITestS3AContractRootDir failure on non-S3Guarded bucket Sub-task Resolved Unassigned  
        2.
        Document `dynamodb:TagResource` an explicit client-side permission for S3Guard Sub-task Resolved Gabor Bota  
        3.
        S3A delegation token binding to support secondary binding list Sub-task Resolved Steve Loughran  
        4.
        hadoop-cloud-storage transient dependencies need review Sub-task Resolved Steve Loughran  
        5.
        NPE in s3a byte buffer block upload Sub-task Resolved Unassigned  
        6.
        ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency? Sub-task Resolved Unassigned  
        7.
        compatibility table in directory_markers.md doesn't render right Sub-task Resolved Masatake Iwasaki  
        8.
        abfs & s3a FS instantiate triggers warning about deprecated io.bytes.per.checksum Sub-task Resolved Unassigned  
        9.
        Address JavaDoc warnings in classes like MarkerTool, S3ObjectAttributes, etc. Sub-task Resolved Ankit Saurabh  
        10.
        ITestCustomSigner fails with NPE against private endpoint Sub-task Resolved Unassigned  
        11.
        typo in TestNeworkBinding Sub-task Resolved Steve Loughran  
        12.
        Improve S3A delegations token documentation Sub-task Resolved Ahmar Suhail

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 20m
        13.
        ITestS3APrefetchingInputStream does not skip if no CSV test file available Sub-task Resolved Daniel Carl Jones  
        14.
        support multiple s3a integration test runs on same bucket in parallel Sub-task Resolved Steve Loughran  
        15.
        Add BulkDelete API for paged delete of files and objects Sub-task Resolved Mukund Thakur  
        16.
        S3A audit header to include count of items in delete ops Sub-task Resolved Viraj Jasani  
        17.
        S3A ITestS3ABucketExistence access point test failure Sub-task Resolved Steve Loughran  
        18.
        S3ABlockOutputStream doesn't collect stats on multipart block uploads Sub-task Resolved Steve Loughran  
        19.
        Change fs.s3a.directory.marker.retention to "keep" Sub-task Resolved Steve Loughran  
        20.
        Upgrade aws-java-sdk to 1.12.367+ Sub-task Resolved Viraj Jasani  
        21.
        Make it possible to disable ITestS3ATemporaryCredentials Sub-task Resolved Unassigned  
        22.
        Upgrade aws-java-sdk to 1.12.499+ Sub-task Resolved Viraj Jasani  
        23.
        Add ability to configure ConnectionTTL of http connections while creating S3 Client. Sub-task Resolved Mukund Thakur  
        24.
        ITestS3GuardTool fails if SSE/DSSE encryption is used Sub-task Resolved Viraj Jasani  
        25.
        S3A: Upgrade AWS SDK version to 2.21.33 for Amazon S3 Express One Zone support Sub-task Resolved Ahmar Suhail  
        26.
        fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header. Sub-task Resolved Mukund Thakur  
        27.
        TestStagingCommitter.testJobCommitFailure failing Sub-task Resolved Mukund Thakur  
        28.
        ITestS3ACommitterFactory failing Sub-task Resolved Steve Loughran  
        29.
        S3A: Support external id in assume role Sub-task Resolved Smith Cruise  
        30.
        S3A: ITestAssumeRole.testAssumeRoleBadInnerAuth failure Sub-task Resolved Steve Loughran  

        Activity

          stevel@apache.org Steve Loughran created issue -
          stevel@apache.org Steve Loughran made changes -
          Field Original Value New Value
          Link This issue supercedes HADOOP-18067 [ HADOOP-18067 ]
          stevel@apache.org Steve Loughran made changes -
          Link This issue depends upon HADOOP-18028 [ HADOOP-18028 ]
          stevel@apache.org Steve Loughran made changes -
          Link This issue depends upon HADOOP-18179 [ HADOOP-18179 ]
          stevel@apache.org Steve Loughran made changes -
          Link This issue depends upon HADOOP-18073 [ HADOOP-18073 ]
          stevel@apache.org Steve Loughran made changes -
          Assignee Mehakmeet Singh [ mehakmeetsingh ]
          stevel@apache.org Steve Loughran made changes -
          Fix Version/s 3.4.1 [ 12354173 ]
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          stevel@apache.org Steve Loughran made changes -
          Link This issue is superceded by HADOOP-19353 [ HADOOP-19353 ]
          stevel@apache.org Steve Loughran made changes -
          Comment [ aah, just accidentally moved all subtasks, even closed ones. will restore ]
          stevel@apache.org Steve Loughran made changes -
          Summary Über-jira: S3A Hadoop 3.3.9 features Über-jira: S3A Hadoop 3.3.9-3.4.1 features

          People

            Unassigned Unassigned
            stevel@apache.org Steve Loughran
            Votes:
            1 Vote for this issue
            Watchers:
            Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                Slack