[HADOOP-973] NPE in FSDataset during heavy Namenode load

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1, 0.11.0
• Fix Version/s: 0.12.0
• Assignee: Dhruba Borthakur
• Reporter: Nigel Daley
• Created: 05/Feb/07 07:42
• Updated: 08/Jul/09 16:42
• Resolved: 16/Feb/07 21:14

Description

Running namenode delete benchmark, I saw many of these NPE's traces in a datanode log:

...
2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_-949112377379974621
2007-02-04 16:17:53,744 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_748220495971269869
2007-02-04 16:17:54,619 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_658746956471887871
2007-02-04 16:17:56,752 ERROR org.apache.hadoop.dfs.DataNode: Exception: java.lang.NullPointerException
at org.apache.hadoop.dfs.FSDataset.invalidate(FSDataset.java:519)
at org.apache.hadoop.dfs.DataNode.offerService(DataNode.java:410)
at org.apache.hadoop.dfs.DataNode.run(DataNode.java:1033)
at java.lang.Thread.run(Thread.java:595)
2007-02-04 16:18:01,754 INFO org.apache.hadoop.dfs.DataNode: using BLOCKREPORT_INTERVAL of 3329089msec
2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_1657305102826276927
2007-02-04 16:18:02,577 INFO org.apache.hadoop.dfs.DataNode: Deleting block blk_589129256174830133
...

Issue Links

• is duplicated by: HADOOP-799 NullPointerException in FSDataset