Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-14144

s3guard: CLI diff non-empty after import on new table

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • HADOOP-13345
    • fs/s3
    • None

    Description

      I expected the following steps to yield zero diff from `hadoop s3guard diff` command.

      (1) hadoop s3guard init ... (create fresh table)
      (2) hadoop s3guard import (fresh table, existing bucket with data in it)
      (3) hadoop s3guard diff ..

      Instead I still get a non-zero diff on step #3. I also noticed some entries are printed twice.

      dude@computer:~/Code/hadoop$ hadoop s3guard diff -meta dynamodb://dude-dev -region us-west-2 s3a://dude-dev
      S3      D       s3a://dude-dev/user/fabbri/test/parentdirdest
      S3      D       s3a://dude-dev/user/fabbri/test/parentdirdest
      

      Attachments

        1. HADOOP-14144-HADOOP-13345.004.patch
          10 kB
          Aaron Fabbri
        2. HADOOP-14144-HADOOP-13345.003.patch
          10 kB
          Aaron Fabbri
        3. HADOOP-14144-HADOOP-13345.002.patch
          10 kB
          Aaron Fabbri
        4. HADOOP-14144-HADOOP-13345.001.patch
          9 kB
          Sean Mackrory

        Activity

          People

            mackrorysd Sean Mackrory
            fabbri Aaron Fabbri
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: