[HDFS-6094] The same block can be counted twice towards safe mode threshold

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Arpit Agarwal
• Reporter: Arpit Agarwal
• Created: 12/Mar/14 02:39
• Updated: 03/Nov/16 08:11
• Resolved: 17/Mar/14 17:43

Description

BlockManager#addStoredBlock can cause the same block can be counted towards safe mode threshold. We see this manifest via TestHASafeMode#testBlocksAddedWhileStandbyIsDown failures on Ubuntu. More details to follow in a comment.

Exception details:

  Time elapsed: 12.874 sec  <<< FAILURE!
java.lang.AssertionError: Bad safemode status: 'Safe mode is ON. The reported blocks 7 has reached the threshold 0.9990 of total blocks 6. The number of live datanodes 3 has reached the minimum number 0. Safe mode will be turned off automatically in 28 seconds.'
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode.assertSafeMode(TestHASafeMode.java:493)
        at org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode.testBlocksAddedWhileStandbyIsDown(TestHASafeMode.java:660)

Issue Links

• duplicates: HDFS-6148 LeaseManager crashes while initiating block recovery
• duplicates: HDFS-5997 TestHASafeMode#testBlocksAddedWhileStandbyIsDown fails in trunk
• is related to: HDFS-11097 Fix the jenkins warning related to the deprecated method StorageReceivedDeletedBlocks