Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13345 S3Guard: Improved Consistency for S3A
  3. HADOOP-14266

S3Guard: S3AFileSystem::listFiles() to employ MetadataStore

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HADOOP-13345
    • HADOOP-13345
    • fs/s3
    • None

    Description

      Similar to HADOOP-13926, this is to track the effort of employing MetadataStore in S3AFileSystem::listFiles().

      Attachments

        1. HADOOP-14266-HADOOP-13345-005.patch
          25 kB
          Steve Loughran
        2. HADOOP-14266-HADOOP-13345.007.patch
          26 kB
          Mingliang Liu
        3. HADOOP-14266-HADOOP-13345.006.patch
          26 kB
          Mingliang Liu
        4. HADOOP-14266-HADOOP-13345.005.patch
          23 kB
          Mingliang Liu
        5. HADOOP-14266-HADOOP-13345.004.patch
          23 kB
          Mingliang Liu
        6. HADOOP-14266-HADOOP-13345.003.patch
          23 kB
          Mingliang Liu
        7. HADOOP-14266-HADOOP-13345.003.patch
          23 kB
          Mingliang Liu
        8. HADOOP-14266-HADOOP-13345.002.patch
          22 kB
          Mingliang Liu
        9. HADOOP-14266-HADOOP-13345.001.patch
          22 kB
          Mingliang Liu
        10. HADOOP-14266-HADOOP-13345.000.patch
          22 kB
          Mingliang Liu

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue HADOOP-14321 Explicitly exclude S3A root dir ITests from parallel runs

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        Is contained by

        Sub-task - The sub-task of the issue HADOOP-14165 Add S3Guard.dirListingUnion in S3AFileSystem#listFiles, listLocatedStatus

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed
        is related to

        Sub-task - The sub-task of the issue HADOOP-13926 S3Guard: S3AFileSystem::listLocatedStatus() to employ MetadataStore

        • Major - Major loss of function.
        • Resolved
        relates to

        Sub-task - The sub-task of the issue HADOOP-14172 S3Guard: import does not import empty directory

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            liuml07 Mingliang Liu
            liuml07 Mingliang Liu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment