Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-14488

s3guard w/ failure injection: listStatus fails after renaming file into directory

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • HADOOP-13345
    • fs/s3
    • None

    Description

      Running scala integration test with inconsistent s3 client & local DDB enabled

      fs.rename("work/task-00/part-00", work)
fs.listStatus(work)

      The list status work fails with a message about the childStatus not being a child of the parent.

      Hypothesis: rename isn't updating the child path entry

      Attachments

        1. HADOOP-14488-HADOOP-13345-001.patch
          2 kB
          Steve Loughran
        2. output.txt
          44 kB
          Steve Loughran
        3. HADOOP-14488-HADOOP-13345-002.patch
          4 kB
          Sean Mackrory
        4. HADOOP-14488-HADOOP-13345-003.patch
          4 kB
          Sean Mackrory
        5. HADOOP-14488-HADOOP-13345-004.patch
          11 kB
          Sean Mackrory
        6. HADOOP-14488-HADOOP-13345-005.patch
          12 kB
          Aaron Fabbri

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue HADOOP-13998 Merge initial S3guard release into trunk

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Sub-task - The sub-task of the issue HADOOP-14509 InconsistentAmazonS3Client adds extra paths to listStatus() after delete.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              mackrorysd Sean Mackrory
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: