Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6094

The same block can be counted twice towards safe mode threshold

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 2.4.0
    • namenode
    • None
    • Reviewed

    Description

      BlockManager#addStoredBlock can cause the same block can be counted towards safe mode threshold. We see this manifest via TestHASafeMode#testBlocksAddedWhileStandbyIsDown failures on Ubuntu. More details to follow in a comment.

      Exception details:

        Time elapsed: 12.874 sec  <<< FAILURE!
      java.lang.AssertionError: Bad safemode status: 'Safe mode is ON. The reported blocks 7 has reached the threshold 0.9990 of total blocks 6. The number of live datanodes 3 has reached the minimum number 0. Safe mode will be turned off automatically in 28 seconds.'
              at org.junit.Assert.fail(Assert.java:93)
              at org.junit.Assert.assertTrue(Assert.java:43)
              at org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode.assertSafeMode(TestHASafeMode.java:493)
              at org.apache.hadoop.hdfs.server.namenode.ha.TestHASafeMode.testBlocksAddedWhileStandbyIsDown(TestHASafeMode.java:660)
      

      Attachments

        1. TestHASafeMode-output.txt
          263 kB
          Jing Zhao
        2. HDFS-6904.01.patch
          2 kB
          Arpit Agarwal
        3. HDFS-6094.03.patch
          29 kB
          Arpit Agarwal

        Issue Links

          Activity

            People

              arp Arpit Agarwal
              arp Arpit Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: