Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-19954

Separate TestBlockReorder into individual tests to avoid ShutdownHook suppression error against hadoop3

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      hadoop3 minidfscluster removes all shutdown handlers when the cluster goes down which made this test that does FS-stuff fail (Fix was to break up the test so each test method ran with an unadulterated FS).

      Description

      TestBlockReorder fails against hadoop 3 due to the following error:

      2018-02-08 17:22:23,389 ERROR [RS:0;cn012:38253] helpers.MarkerIgnoringBase(159): ***** ABORTING region server cn012.l42scl.hortonworks.com,38253,1518110542271: Unhandled: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6a0c707e *****
      java.lang.RuntimeException: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6a0c707e
        at org.apache.hadoop.hbase.regionserver.ShutdownHook.suppressHdfsShutdownHook(ShutdownHook.java:207)
        at org.apache.hadoop.hbase.regionserver.ShutdownHook.install(ShutdownHook.java:85)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:927)
        at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:187)
      

      This is because when MiniDFSCluster is stopped in first subtest, hadoop 3 clears ShutdownHook.
      When the 2nd test starts, suppression of ShutdownHook fails.

        Attachments

        1. 19954.v1.txt
          5 kB
          Ted Yu
        2. 19954.v2.txt
          6 kB
          Ted Yu
        3. 19954.v3.txt
          30 kB
          Ted Yu
        4. 19954.v4.txt
          32 kB
          Ted Yu

          Issue Links

            Activity

              People

              • Assignee:
                yuzhihong@gmail.com Ted Yu
                Reporter:
                yuzhihong@gmail.com Ted Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: