Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4993

fsck can fail if a file is renamed or deleted

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.0-beta, 0.23.9, 3.0.0-alpha1
    • Fix Version/s: 0.23.10, 2.1.1-beta
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      In NamenodeFsck#check(), the getListing() and getBlockLocations() are not synchronized, so the file deletions or renames at the right moment can cause FileNotFoundException and failure of fsck.

      Instead of failing, fsck should continue. Optionally it can record file system modifications it encountered, but since most modifications during fsck are not detected, there might be little value in recording these specifically.

        Attachments

        1. HDFS-4993.patch
          5 kB
          Robert Parker
        2. HDFS-4993-branch_0.23.patch
          5 kB
          Robert Parker

          Activity

            People

            • Assignee:
              robsparker Robert Parker
              Reporter:
              kihwal Kihwal Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: