Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226

Über-JIRA: S3Guard Phase III: Hadoop 3.2 features

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0, 3.1.0
    • 3.2.0
    • fs/s3
    • None

    Description

      S3Guard features/improvements/fixes for Hadoop 3.2

      Attachments

        Issue Links

          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-15220 Über-jira: S3a phase V: Hadoop 3.2 features

          • Major - Major loss of function.
          • Resolved
          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15619 Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features

          • Major - Major loss of function.
          • Resolved
          supercedes

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-14825 Über-JIRA: S3Guard Phase II: Hadoop 3.1 features

          • Major - Major loss of function.
          • Resolved
          1.
          		 add option to tag DDB table(s) created Sub-task Resolved Gabor Bota
          2.
          		 s3guard set-capacity command to fail on read/write of 0 Sub-task Resolved Gabor Bota
          3.
          		 S3GuardTool.prune to handle UnsupportedOperationException Sub-task Resolved Gabor Bota
          4.
          		 ITestS3ATemporaryCredentials to cover all ddb metastore ops with session credentials Sub-task Resolved Gabor Bota
          5.
          		 s3guard IT tests increase R/W capacity of the test table by 1 Sub-task Resolved Steve Loughran
          6.
          		 Remove the Local Dynamo DB test option Sub-task Resolved Gabor Bota
          7.
          		 Intermittent failure of S3Guard TestConsistencyListFiles Sub-task Resolved Unassigned
          8.
          		 S3Guard: expose capability query in MetadataStore and add tests of authoritative mode Sub-task Resolved Gabor Bota
          9.
          		 Add integration test version of TestMetadataStore for DynamoDB Sub-task Resolved Sean Mackrory
          10.
          		 S3Guard testPruneCommandCLI can fail Sub-task Resolved Gabor Bota
          11.
          		 S3GuardTool prune to prune specific bucket entries Sub-task Resolved Gabor Bota
          12.
          		 Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support) Sub-task Resolved Gabor Bota
          13.
          		 S3Guard DDB retryBackoff to be more informative on limits exceeded Sub-task Resolved Gabor Bota
          14.
          		 (transient) ITestS3AInconsistency.testOpenFailOnRead S3Guard failure Sub-task Resolved Unassigned
          15.
          		 s3guard diff assert failure if source path not found Sub-task Resolved Gabor Bota
          16.
          		 s3guard ITestS3GuardToolLocal failures in diff tests Sub-task Resolved Gabor Bota
          17.
          		 s3guard doesn't init when the secrets are in the s3a URI Sub-task Resolved Unassigned
          18.
          		 LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. Sub-task Resolved Gabor Bota
          19.
          		 Merge fileCache and dirCache into one single cache in LocalMetadataStore Sub-task Resolved Gabor Bota
          20.
          		 s3guard: implement time-based (TTL) expiry for LocalMetadataStore Sub-task Resolved Gabor Bota
          21.
          		 Make S3guard client resilient to DDB throttle events and network failures Sub-task Resolved Steve Loughran
          22.
          		 TestDynamoDBMetadataStore test case fails on PPC Sub-task Resolved Unassigned
          23.
          		 ITestS3GuardToolDynamo should only run with -Ddynamo Sub-task Resolved Aaron Fabbri
          24.
          		 AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo Sub-task Resolved Gabor Bota
          25.
          		 Improve S3Guard documentation on Authoritative Mode implementation Sub-task Resolved Gabor Bota
          26.
          		 s3guard: testDynamoTableTagging should clear existing config Sub-task Resolved Gabor Bota
          27.
          		 ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence Sub-task Resolved Gabor Bota
          28.
          		 Test S3Guard ops with assumed roles & verify required permissions Sub-task Resolved Steve Loughran
          29.
          		 Add ITestDynamoDBMetadataStore Sub-task Resolved Gabor Bota
          30.
          		 ITestS3GuardToolLocal.testDiffCommand fails if bucket has per-bucket binding to DDB Sub-task Resolved Steve Loughran

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: