Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.3.0
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:

      Description

      HADOOP-15183 added detection and rejection of prune updates when the store is inconsistent (i.e. when it tries to update an entry twice in the same operation, the second time with one that is inconsistent with the first)

      Now that we can detect this, we should address it. We are lucky here in that my DDB table is currently inconsistent: prune is failing.

      Plan

      1. new test to run in the sequential phase, which does a s3guard prune against the bucket used in tests
      2. use this to identify/debug the issue
      3. replicate the problem in the ITestDDBMetastore tests
      4. decide what to do in this world. Tell the user to run fsck? skip?

        Attachments

        1. hwdev-ireland-new.csv
          12 kB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: