Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-13908

S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HADOOP-13345
    • HADOOP-13345
    • fs/s3
    • None

    Description

      This was based on discussion in HADOOP-13455. Though we should not create table unless the config fs.s3a.s3guard.ddb.table.create is set true, we still have to get the existing table in DynamoDBMetadataStore#initialize() and wait for its becoming active, before any table/item operations.

      Attachments

        1. HADOOP-13908-HADOOP-13345.000.patch
          3 kB
          Mingliang Liu
        2. HADOOP-13908-HADOOP-13345.001.patch
          8 kB
          Mingliang Liu
        3. HADOOP-13908-HADOOP-13345.002.patch
          8 kB
          Mingliang Liu
        4. HADOOP-13908-HADOOP-13345.002.patch
          8 kB
          Mingliang Liu
        5. HADOOP-13908-HADOOP-13345.003.patch
          8 kB
          Mingliang Liu
        6. HADOOP-13908-HADOOP-13345.004.patch
          9 kB
          Mingliang Liu
        7. HADOOP-13908-HADOOP-13345.005.patch
          8 kB
          Mingliang Liu
        8. HADOOP-13908-HADOOP-13345.006.patch
          9 kB
          Mingliang Liu

        Issue Links

          Activity

            People

              liuml07 Mingliang Liu
              liuml07 Mingliang Liu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: