Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226 Über-JIRA: S3Guard Phase III: Hadoop 3.2 features
  3. HADOOP-14154

Persist isAuthoritative bit in DynamoDBMetaStore (authoritative mode support)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-beta1
    • Fix Version/s: 3.2.0
    • Component/s: fs/s3
    • Labels:
      None

      Description

      Add support for "authoritative mode" for DynamoDBMetadataStore.

      The missing feature is to persist the bit set in DirListingMetadata.isAuthoritative

      This topic has been super confusing for folks so I will also file a documentation Jira to explain the design better.

      We may want to also rename the DirListingMetadata.isAuthoritative field to .isFullListing to eliminate the multiple uses and meanings of the word "authoritative".

       

        Attachments

        1. HADOOP-14154-HADOOP-13345.001.patch
          9 kB
          Rajesh Balamohan
        2. HADOOP-14154-HADOOP-13345.002.patch
          9 kB
          Rajesh Balamohan
        3. HADOOP-14154-spec-001.pdf
          84 kB
          Gabor Bota
        4. HADOOP-14154-spec-002.pdf
          85 kB
          Gabor Bota
        5. HADOOP-14154.001.patch
          13 kB
          Gabor Bota
        6. HADOOP-14154.002.patch
          24 kB
          Gabor Bota
        7. HADOOP-14154.003.patch
          25 kB
          Gabor Bota
        8. perf-eval-v1.diff
          2 kB
          Aaron Fabbri
        9. run-dir-perf-itest.sh
          2 kB
          Aaron Fabbri
        10. HADOOP-14154.004.patch
          29 kB
          Gabor Bota
        11. run-dir-perf-itest-v2.sh
          2 kB
          Gabor Bota
        12. HADOOP-14154.005.patch
          30 kB
          Gabor Bota
        13. all-logs.txt
          21 kB
          Gabor Bota
        14. HADOOP-14154.006.patch
          29 kB
          Aaron Fabbri
        15. HADOOP-14154.007.patch
          29 kB
          Aaron Fabbri

          Issue Links

            Activity

              People

              • Assignee:
                gabor.bota Gabor Bota
                Reporter:
                rajesh.balamohan Rajesh Balamohan
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: