Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226 Über-JIRA: S3Guard Phase III: Hadoop 3.2 features
  3. HADOOP-14154

Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-beta1
    • 3.2.0
    • fs/s3
    • None

    Description

      Add support for "authoritative mode" for DynamoDBMetadataStore.

      The missing feature is to persist the bit set in DirListingMetadata.isAuthoritative. 

      This topic has been super confusing for folks so I will also file a documentation Jira to explain the design better.

      We may want to also rename the DirListingMetadata.isAuthoritative field to .isFullListing to eliminate the multiple uses and meanings of the word "authoritative".

       

      Attachments

        1. HADOOP-14154.007.patch
          29 kB
          Aaron Fabbri
        2. HADOOP-14154.006.patch
          29 kB
          Aaron Fabbri
        3. all-logs.txt
          21 kB
          Gabor Bota
        4. HADOOP-14154.005.patch
          30 kB
          Gabor Bota
        5. run-dir-perf-itest-v2.sh
          2 kB
          Gabor Bota
        6. HADOOP-14154.004.patch
          29 kB
          Gabor Bota
        7. run-dir-perf-itest.sh
          2 kB
          Aaron Fabbri
        8. perf-eval-v1.diff
          2 kB
          Aaron Fabbri
        9. HADOOP-14154.003.patch
          25 kB
          Gabor Bota
        10. HADOOP-14154.002.patch
          24 kB
          Gabor Bota
        11. HADOOP-14154.001.patch
          13 kB
          Gabor Bota
        12. HADOOP-14154-spec-002.pdf
          85 kB
          Gabor Bota
        13. HADOOP-14154-spec-001.pdf
          84 kB
          Gabor Bota
        14. HADOOP-14154-HADOOP-13345.002.patch
          9 kB
          Rajesh Balamohan
        15. HADOOP-14154-HADOOP-13345.001.patch
          9 kB
          Rajesh Balamohan

        Issue Links

        is blocked by

        Sub-task - The sub-task of the issue HADOOP-15636 Add ITestDynamoDBMetadataStore

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        is related to

        Sub-task - The sub-task of the issue HADOOP-15400 Improve S3Guard documentation on Authoritative Mode implementation

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gabor.bota Gabor Bota
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment