Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6094

The same block can be counted twice towards safe mode threshold

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.4.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      BlockManager#addStoredBlock can cause the same block can be counted towards safe mode threshold. We see this manifest via TestHASafeMode#testBlocksAddedWhileStandbyIsDown failures on Ubuntu. More details to follow in a comment.

      Exception details:

        Time elapsed: 12.874 sec  <<< FAILURE!
      java.lang.AssertionError: Bad safemode status: 'Safe mode is ON. The reported blocks 7 has reached the threshold 0.9990 of total blocks 6. The number of live datanodes 3 has reached the minimum number 0. Safe mode will be turned off automatically in 28 seconds.'
              at org.junit.Assert.fail(Assert.java:93)
              at org.junit.Assert.assertTrue(Assert.java:43)
              at org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode.assertSafeMode(TestHASafeMode.java:493)
              at org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode.testBlocksAddedWhileStandbyIsDown(TestHASafeMode.java:660)
      
      1. TestHASafeMode-output.txt
        263 kB
        Jing Zhao
      2. HDFS-6904.01.patch
        2 kB
        Arpit Agarwal
      3. HDFS-6094.03.patch
        29 kB
        Arpit Agarwal

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Arpit Agarwal
              Reporter:
              Arpit Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development