Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226

Über-JIRA: S3Guard Phase III: Hadoop 3.2 features

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0, 3.1.0
    • 3.2.0
    • fs/s3
    • None

    Description

      S3Guard features/improvements/fixes for Hadoop 3.2

      Attachments

        Issue Links

        1.
        add option to tag DDB table(s) created Sub-task Resolved Gabor Bota Actions
        2.
        s3guard set-capacity command to fail on read/write of 0 Sub-task Resolved Gabor Bota Actions
        3.
        S3GuardTool.prune to handle UnsupportedOperationException Sub-task Resolved Gabor Bota Actions
        4.
        ITestS3ATemporaryCredentials to cover all ddb metastore ops with session credentials Sub-task Resolved Gabor Bota Actions
        5.
        s3guard IT tests increase R/W capacity of the test table by 1 Sub-task Resolved Steve Loughran Actions
        6.
        Remove the Local Dynamo DB test option Sub-task Resolved Gabor Bota Actions
        7.
        Intermittent failure of S3Guard TestConsistencyListFiles Sub-task Resolved Unassigned Actions
        8.
        S3Guard: expose capability query in MetadataStore and add tests of authoritative mode Sub-task Resolved Gabor Bota Actions
        9.
        Add integration test version of TestMetadataStore for DynamoDB Sub-task Resolved Sean Mackrory Actions
        10.
        S3Guard testPruneCommandCLI can fail Sub-task Resolved Gabor Bota Actions
        11.
        S3GuardTool prune to prune specific bucket entries Sub-task Resolved Gabor Bota Actions
        12.
        Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support) Sub-task Resolved Gabor Bota Actions
        13.
        S3Guard DDB retryBackoff to be more informative on limits exceeded Sub-task Resolved Gabor Bota Actions
        14.
        (transient) ITestS3AInconsistency.testOpenFailOnRead S3Guard failure Sub-task Resolved Unassigned Actions
        15.
        s3guard diff assert failure if source path not found Sub-task Resolved Gabor Bota Actions
        16.
        s3guard ITestS3GuardToolLocal failures in diff tests Sub-task Resolved Gabor Bota Actions
        17.
        s3guard doesn't init when the secrets are in the s3a URI Sub-task Resolved Unassigned Actions
        18.
        LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash. Sub-task Resolved Gabor Bota Actions
        19.
        Merge fileCache and dirCache into one single cache in LocalMetadataStore Sub-task Resolved Gabor Bota Actions
        20.
        s3guard: implement time-based (TTL) expiry for LocalMetadataStore Sub-task Resolved Gabor Bota Actions
        21.
        Make S3guard client resilient to DDB throttle events and network failures Sub-task Resolved Steve Loughran Actions
        22.
        TestDynamoDBMetadataStore test case fails on PPC Sub-task Resolved Unassigned Actions
        23.
        ITestS3GuardToolDynamo should only run with -Ddynamo Sub-task Resolved Aaron Fabbri Actions
        24.
        AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo Sub-task Resolved Gabor Bota Actions
        25.
        Improve S3Guard documentation on Authoritative Mode implementation Sub-task Resolved Gabor Bota Actions
        26.
        s3guard: testDynamoTableTagging should clear existing config Sub-task Resolved Gabor Bota Actions
        27.
        ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence Sub-task Resolved Gabor Bota Actions
        28.
        Test S3Guard ops with assumed roles & verify required permissions Sub-task Resolved Steve Loughran Actions
        29.
        Add ITestDynamoDBMetadataStore Sub-task Resolved Gabor Bota Actions
        30.
        ITestS3GuardToolLocal.testDiffCommand fails if bucket has per-bucket binding to DDB Sub-task Resolved Steve Loughran Actions

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment