Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11078

Fix NPE in LazyPersistFileScrubber

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.3
    • Fix Version/s: 2.9.0, 2.7.4, 3.0.0-alpha4, 2.8.2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      If a block is removed, it will be removed from the block map. When the clearCorruptLazyPersistFiles() tries to delete the block, it may already be deleted and generate a null pointer exception.

      java.lang.NullPointerException
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.clearCorruptLazyPersistFiles(FSNamesystem.java:3820)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.run(FSNamesystem.java:3851)
      at java.lang.Thread.run(Thread.java:745)

        Attachments

        1. HDFS-11078-branch-2.7.patch
          1 kB
          Íñigo Goiri
        2. HDFS-11078.001.patch
          1 kB
          Íñigo Goiri
        3. HDFS-11078.000.patch
          1 kB
          Íñigo Goiri

          Issue Links

          relates to

          Task - A task that needs to be done. HDFS-11869 Backport HDFS-11078 to branch 2.7

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                elgoiri Íñigo Goiri
                Reporter:
                elgoiri Íñigo Goiri
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: