Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-14266

S3Guard: S3AFileSystem::listFiles() to employ MetadataStore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HADOOP-13345
    • HADOOP-13345
    • fs/s3
    • None

    Description

      Similar to HADOOP-13926, this is to track the effort of employing MetadataStore in S3AFileSystem::listFiles().

      Attachments

        1. HADOOP-14266-HADOOP-13345-005.patch
          25 kB
          Steve Loughran
        2. HADOOP-14266-HADOOP-13345.007.patch
          26 kB
          Mingliang Liu
        3. HADOOP-14266-HADOOP-13345.006.patch
          26 kB
          Mingliang Liu
        4. HADOOP-14266-HADOOP-13345.005.patch
          23 kB
          Mingliang Liu
        5. HADOOP-14266-HADOOP-13345.004.patch
          23 kB
          Mingliang Liu
        6. HADOOP-14266-HADOOP-13345.003.patch
          23 kB
          Mingliang Liu
        7. HADOOP-14266-HADOOP-13345.003.patch
          23 kB
          Mingliang Liu
        8. HADOOP-14266-HADOOP-13345.002.patch
          22 kB
          Mingliang Liu
        9. HADOOP-14266-HADOOP-13345.001.patch
          22 kB
          Mingliang Liu
        10. HADOOP-14266-HADOOP-13345.000.patch
          22 kB
          Mingliang Liu

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HADOOP-14321 Explicitly exclude S3A root dir ITests from parallel runs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          Is contained by

          Sub-task - The sub-task of the issue HADOOP-14165 Add S3Guard.dirListingUnion in S3AFileSystem#listFiles, listLocatedStatus

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          Sub-task - The sub-task of the issue HADOOP-13926 S3Guard: S3AFileSystem::listLocatedStatus() to employ MetadataStore

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-14172 S3Guard: import does not import empty directory

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              liuml07 Mingliang Liu
              liuml07 Mingliang Liu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: