[HDFS-11078] Fix NPE in LazyPersistFileScrubber

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3
• Fix Version/s: 2.9.0, 2.7.4, 3.0.0-alpha4, 2.8.2
• Target Version/s: 2.7.4
• Hadoop Flags: Reviewed
• Assignee: Íñigo Goiri
• Reporter: Íñigo Goiri
• Created: 31/Oct/16 23:53
• Updated: 31/Aug/17 22:26
• Resolved: 26/May/17 20:45

Description

If a block is removed, it will be removed from the block map. When the clearCorruptLazyPersistFiles() tries to delete the block, it may already be deleted and generate a null pointer exception.

java.lang.NullPointerException
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.clearCorruptLazyPersistFiles(FSNamesystem.java:3820)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.run(FSNamesystem.java:3851)
at java.lang.Thread.run(Thread.java:745)

Issue Links

• relates to: HDFS-11869 Backport HDFS-11078 to branch 2.7