Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-13908

S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HADOOP-13345
    • Fix Version/s: HADOOP-13345
    • Component/s: fs/s3
    • Labels:
      None

      Description

      This was based on discussion in HADOOP-13455. Though we should not create table unless the config fs.s3a.s3guard.ddb.table.create is set true, we still have to get the existing table in DynamoDBMetadataStore#initialize() and wait for its becoming active, before any table/item operations.

        Attachments

        1. HADOOP-13908-HADOOP-13345.000.patch
          3 kB
          Mingliang Liu
        2. HADOOP-13908-HADOOP-13345.001.patch
          8 kB
          Mingliang Liu
        3. HADOOP-13908-HADOOP-13345.002.patch
          8 kB
          Mingliang Liu
        4. HADOOP-13908-HADOOP-13345.002.patch
          8 kB
          Mingliang Liu
        5. HADOOP-13908-HADOOP-13345.003.patch
          8 kB
          Mingliang Liu
        6. HADOOP-13908-HADOOP-13345.004.patch
          9 kB
          Mingliang Liu
        7. HADOOP-13908-HADOOP-13345.005.patch
          8 kB
          Mingliang Liu
        8. HADOOP-13908-HADOOP-13345.006.patch
          9 kB
          Mingliang Liu

          Issue Links

            Activity

              People

              • Assignee:
                liuml07 Mingliang Liu
                Reporter:
                liuml07 Mingliang Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: