Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11067

DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha4
    • hdfs-client
    • None
    • Incompatible change
    • DistributedFileSystem#listStatusIterator(..) throws FileNotFoundException if directory got deleted during iterating over large list beyond ls limit.

    Description

      DFS#listStatusIterator(..) currently stops iterating silently when the directory gets deleted before fetching the next batch of entries.

      It should throw FileNotFoundException() and let user know that file is deleted in the middle.

      Attachments

        1. HDFS-11067-01.patch
          2 kB
          Vinayakumar B
        2. HDFS-11067-02.patch
          3 kB
          Vinayakumar B
        3. HDFS-11067-03.patch
          4 kB
          Vinayakumar B
        4. HDFS-11067-04.patch
          4 kB
          Vinayakumar B

        Activity

          People

            vinayakumarb Vinayakumar B
            vinayakumarb Vinayakumar B
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: