Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226 Über-JIRA: S3Guard Phase III: Hadoop 3.2 features
  3. HADOOP-14154

Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-beta1
    • 3.2.0
    • fs/s3
    • None

    Description

      Add support for "authoritative mode" for DynamoDBMetadataStore.

      The missing feature is to persist the bit set in DirListingMetadata.isAuthoritative. 

      This topic has been super confusing for folks so I will also file a documentation Jira to explain the design better.

      We may want to also rename the DirListingMetadata.isAuthoritative field to .isFullListing to eliminate the multiple uses and meanings of the word "authoritative".

       

      Attachments

        1. all-logs.txt
          21 kB
          Gabor Bota
        2. HADOOP-14154.001.patch
          13 kB
          Gabor Bota
        3. HADOOP-14154.002.patch
          24 kB
          Gabor Bota
        4. HADOOP-14154.003.patch
          25 kB
          Gabor Bota
        5. HADOOP-14154.004.patch
          29 kB
          Gabor Bota
        6. HADOOP-14154.005.patch
          30 kB
          Gabor Bota
        7. HADOOP-14154.006.patch
          29 kB
          Aaron Fabbri
        8. HADOOP-14154.007.patch
          29 kB
          Aaron Fabbri
        9. HADOOP-14154-HADOOP-13345.001.patch
          9 kB
          Rajesh Balamohan
        10. HADOOP-14154-HADOOP-13345.002.patch
          9 kB
          Rajesh Balamohan
        11. HADOOP-14154-spec-001.pdf
          84 kB
          Gabor Bota
        12. HADOOP-14154-spec-002.pdf
          85 kB
          Gabor Bota
        13. perf-eval-v1.diff
          2 kB
          Aaron Fabbri
        14. run-dir-perf-itest.sh
          2 kB
          Aaron Fabbri
        15. run-dir-perf-itest-v2.sh
          2 kB
          Gabor Bota

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue HADOOP-15636 Add ITestDynamoDBMetadataStore

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HADOOP-15400 Improve S3Guard documentation on Authoritative Mode implementation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              gabor.bota Gabor Bota
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: