Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11067

DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha4
    • Component/s: hdfs-client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change
    • Release Note:
      DistributedFileSystem#listStatusIterator(..) throws FileNotFoundException if directory got deleted during iterating over large list beyond ls limit.

      Description

      DFS#listStatusIterator(..) currently stops iterating silently when the directory gets deleted before fetching the next batch of entries.

      It should throw FileNotFoundException() and let user know that file is deleted in the middle.

        Attachments

        1. HDFS-11067-04.patch
          4 kB
          Vinayakumar B
        2. HDFS-11067-03.patch
          4 kB
          Vinayakumar B
        3. HDFS-11067-02.patch
          3 kB
          Vinayakumar B
        4. HDFS-11067-01.patch
          2 kB
          Vinayakumar B

          Activity

            People

            • Assignee:
              vinayrpet Vinayakumar B
              Reporter:
              vinayrpet Vinayakumar B
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: