Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2680

Unit test fails with a timeout on nightly build: org.apache.hadoop.dfs.TestDFSStorageStateRecovery

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Cannot Reproduce
    • 0.16.0
    • None
    • None
    • None

    Description

      The unit test: TestDFSStorageStateRecovery has failed a couple of times with a timeout on the nightly build:

      Here are the logs from the failures:
      http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/373/console
      http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/369/console

      Here is a build where it passed:
      http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/365/console

      Here is the part where it failed:

      [junit] 2008-01-22 12:16:39,499 INFO dfs.TestDFSStorageStateRecovery (TestDFSStorageStateRecovery.java:log(84)) - ============================================================
      [junit] 2008-01-22 12:16:39,502 INFO dfs.TestDFSStorageStateRecovery (TestDFSStorageStateRecovery.java:log(85)) - **TEST 34** NAME_NODE recovery: numDirs=1 testCase=17 current=false previous=true previous.tmp=false removed.tmp=true
      [junit] 2008-01-22 12:16:39,499 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 4 on 36207: exiting
      [junit] 2008-01-22 12:16:39,499 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 3 on 36207: exiting
      [junit] 2008-01-22 12:16:39,499 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 7 on 36207: exiting
      [junit] 2008-01-22 12:16:39,499 INFO ipc.Server (Server.java:run(353)) - Stopping IPC Server listener on 36207
      [junit] 2008-01-22 12:16:39,499 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 2 on 36207: exiting
      [junit] 2008-01-22 12:16:40,153 INFO jvm.JvmMetrics (RpcMetrics.java:setTags(49)) - Initializing RPC Metrics with serverName=NameNode, port=0
      [junit] javax.management.InstanceAlreadyExistsException: hadoop.dfs:service=NameNode,name=RpcStatistics
      [junit] at com.sun.jmx.mbeanserver.RepositorySupport.addMBean(RepositorySupport.java:452)
      [junit] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1410)
      [junit] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:936)
      [junit] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:337)
      [junit] at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:497)
      [junit] at org.apache.hadoop.metrics.util.MBeanUtil.registerMBean(MBeanUtil.java:50)
      [junit] at org.apache.hadoop.ipc.metrics.RpcMgt.<init>(RpcMgt.java:37)
      [junit] at org.apache.hadoop.ipc.metrics.RpcMetrics.<init>(RpcMetrics.java:60)
      [junit] at org.apache.hadoop.ipc.Server.<init>(Server.java:969)
      [junit] at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:393)
      [junit] at org.apache.hadoop.ipc.RPC.getServer(RPC.java:355)
      [junit] 2008-01-22 12:16:40,156 INFO dfs.NameNode (NameNode.java:initialize(125)) - Namenode up at: localhost/127.0.0.1:36768
      [junit] at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:119)
      [junit] at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:174)
      [junit] 2008-01-22 12:16:40,156 INFO jvm.JvmMetrics (JvmMetrics.java:init(51)) - Cannot initialize JVM Metrics with processName=NameNode, sessionId=null - already initialized
      [junit] at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:160)
      [junit] at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:849)
      [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:195)
      [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:134)
      [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:86)
      [junit] at org.apache.hadoop.dfs.TestDFSStorageStateRecovery.testStorageStates(TestDFSStorageStateRecovery.java:193)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      [junit] at java.lang.reflect.Method.invoke(Method.java:585)
      [junit] at junit.framework.TestCase.runTest(TestCase.java:154)
      [junit] at junit.framework.TestCase.runBare(TestCase.java:127)
      [junit] 2008-01-22 12:16:40,158 INFO dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(74)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
      [junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
      [junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
      [junit] at junit.framework.TestResult.run(TestResult.java:109)
      [junit] at junit.framework.TestCase.run(TestCase.java:118)
      [junit] at junit.framework.TestSuite.runTest(TestSuite.java:208)
      [junit] at junit.framework.TestSuite.run(TestSuite.java:203)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:297)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:672)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:567)
      [junit] javax.management.InstanceAlreadyExistsException: hadoop.dfs:service=NameNode,name=NameNodeStatistics
      [junit] at com.sun.jmx.mbeanserver.RepositorySupport.addMBean(RepositorySupport.java:452)
      [junit] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.internal_addObject(DefaultMBeanServerInterceptor.java:1410)
      [junit] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:936)
      [junit] at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:337)
      [junit] at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:497)
      [junit] at org.apache.hadoop.metrics.util.MBeanUtil.registerMBean(MBeanUtil.java:50)
      [junit] at org.apache.hadoop.dfs.namenode.metrics.NameNodeMgt.<init>(NameNodeMgt.java:36)
      [junit] at org.apache.hadoop.dfs.NameNodeMetrics.<init>(NameNodeMetrics.java:67)
      [junit] at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:127)
      [junit] at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:174)
      [junit] at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:160)
      [junit] at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:849)
      [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:195)
      [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:134)
      [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:86)
      [junit] at org.apache.hadoop.dfs.TestDFSStorageStateRecovery.testStorageStates(TestDFSStorageStateRecovery.java:193)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      [junit] at java.lang.reflect.Method.invoke(Method.java:585)
      [junit] at junit.framework.TestCase.runTest(TestCase.java:154)
      [junit] at junit.framework.TestCase.runBare(TestCase.java:127)
      [junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
      [junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
      [junit] at junit.framework.TestResult.run(TestResult.java:109)
      [junit] at junit.framework.TestCase.run(TestCase.java:118)
      [junit] at junit.framework.TestSuite.runTest(TestSuite.java:208)
      [junit] at junit.framework.TestSuite.run(TestSuite.java:203)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:297)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:672)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:567)
      [junit] 2008-01-22 12:16:40,193 INFO fs.FSNamesystem (FSNamesystem.java:setConfigurationParameters(321)) - fsOwner=hudson,hudson
      [junit] 2008-01-22 12:16:40,195 INFO fs.FSNamesystem (FSNamesystem.java:setConfigurationParameters(325)) - supergroup=supergroup
      [junit] 2008-01-22 12:16:40,195 INFO fs.FSNamesystem (FSNamesystem.java:setConfigurationParameters(326)) - isPermissionEnabled=true
      [junit] 2008-01-22 12:16:40,198 INFO dfs.Storage (Storage.java:doRecover(369)) - Recovering storage directory /export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/name1 from previous rollback.
      [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
      [junit] Test org.apache.hadoop.dfs.TestDFSStorageStateRecovery FAILED (timeout)

      Attachments

        1. build-369-TestEditLog.txt
          15 kB
          Raghu Angadi

        Activity

          People

            shv Konstantin Shvachko
            mukundm Mukund Madhugiri
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: