Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-2037

tajo-storage-hdfs tests occasionally hangs

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0, 0.11.1
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: Unit Test
    • Labels:
      None
    • Environment:

      jetty-6.1.14

      Description

      jetty threads does not terminated occasionally when MiniHDFSCluster are shutdown

      Tests run: 5, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 480.862 sec <<< FAILURE! - in org.apache.tajo.storage.TestFileTablespace
      testGetSplit(org.apache.tajo.storage.TestFileTablespace)  Time elapsed: 120.104 sec  <<< ERROR!
      org.junit.runners.model.TestTimedOutException: test timed out after 120000 milliseconds
      	at java.lang.Thread.sleep(Native Method)
      	at org.mortbay.thread.QueuedThreadPool.doStop(QueuedThreadPool.java:437)
      	at org.mortbay.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:78)
      	at org.mortbay.jetty.Server.doStop(Server.java:289)
      	at org.mortbay.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:78)
      	at org.apache.hadoop.http.HttpServer2.stop(HttpServer2.java:961)
      	at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.close(DatanodeHttpServer.java:210)
      	at org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.java:1682)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSCluster.java:1746)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1721)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705)
      	at org.apache.tajo.storage.TestFileTablespace.testGetSplit(TestFileTablespace.java:169)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
      	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.lang.Thread.run(Thread.java:745)
      

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/927

        TAJO-2037: tajo-storage-hdfs tests occasionally hangs.

        I've upgrade jetty module and enable surefire trace
        please refer to https://github.com/apache/tajo/pull/923

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-2037

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/927.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #927


        commit c5429912046cf8d1b0844abe2f38ee90853b03a6
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2016-01-06T05:52:49Z

        TAJO-2037: tajo-storage-hdfs tests occasionally hangs.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/927 TAJO-2037 : tajo-storage-hdfs tests occasionally hangs. I've upgrade jetty module and enable surefire trace please refer to https://github.com/apache/tajo/pull/923 You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-2037 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/927.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #927 commit c5429912046cf8d1b0844abe2f38ee90853b03a6 Author: Jinho Kim <jhkim@apache.org> Date: 2016-01-06T05:52:49Z TAJO-2037 : tajo-storage-hdfs tests occasionally hangs.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on the pull request:

        https://github.com/apache/tajo/pull/927#issuecomment-169253760

        +1!
        Thanks for your effort!

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on the pull request: https://github.com/apache/tajo/pull/927#issuecomment-169253760 +1! Thanks for your effort!
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/927

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/927
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #642 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/642/)
        TAJO-2037: tajo-storage-hdfs tests occasionally hangs. (jhkim: rev f9825e71bcfca9e187206756d369ee14bcb9be2e)

        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/raw/TestDirectRawFile.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestByteBufLineReader.java
        • CHANGES
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/HttpFileServerHandler.java
        • tajo-cluster-tests/src/test/java/org/apache/tajo/TajoTestingCluster.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestFileTablespace.java
        • tajo-core/pom.xml
        • tajo-project/pom.xml
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #642 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/642/ ) TAJO-2037 : tajo-storage-hdfs tests occasionally hangs. (jhkim: rev f9825e71bcfca9e187206756d369ee14bcb9be2e) tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/raw/TestDirectRawFile.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestByteBufLineReader.java CHANGES tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/HttpFileServerHandler.java tajo-cluster-tests/src/test/java/org/apache/tajo/TajoTestingCluster.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestFileTablespace.java tajo-core/pom.xml tajo-project/pom.xml
        Hide
        jhkim Jinho Kim added a comment -

        committed it.
        Thanks for your quick review!

        Show
        jhkim Jinho Kim added a comment - committed it. Thanks for your quick review!
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-master-build #1040 (See https://builds.apache.org/job/Tajo-master-build/1040/)
        TAJO-2037: tajo-storage-hdfs tests occasionally hangs. (jhkim: rev f9825e71bcfca9e187206756d369ee14bcb9be2e)

        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestFileTablespace.java
        • CHANGES
        • tajo-core/pom.xml
        • tajo-cluster-tests/src/test/java/org/apache/tajo/TajoTestingCluster.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestByteBufLineReader.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/raw/TestDirectRawFile.java
        • tajo-project/pom.xml
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/HttpFileServerHandler.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-master-build #1040 (See https://builds.apache.org/job/Tajo-master-build/1040/ ) TAJO-2037 : tajo-storage-hdfs tests occasionally hangs. (jhkim: rev f9825e71bcfca9e187206756d369ee14bcb9be2e) tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestFileTablespace.java CHANGES tajo-core/pom.xml tajo-cluster-tests/src/test/java/org/apache/tajo/TajoTestingCluster.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestByteBufLineReader.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/raw/TestDirectRawFile.java tajo-project/pom.xml tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/HttpFileServerHandler.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Tajo-0.11.1-build #142 (See https://builds.apache.org/job/Tajo-0.11.1-build/142/)
        TAJO-2037: tajo-storage-hdfs tests occasionally hangs. (jhkim: rev a49c1a66035759da8ccd47c1da912afacc77b034)

        • tajo-project/pom.xml
        • CHANGES
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestByteBufLineReader.java
        • tajo-cluster-tests/src/test/java/org/apache/tajo/TajoTestingCluster.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/HttpFileServerHandler.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/raw/TestDirectRawFile.java
        • tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestFileTablespace.java
        • tajo-core/pom.xml
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Tajo-0.11.1-build #142 (See https://builds.apache.org/job/Tajo-0.11.1-build/142/ ) TAJO-2037 : tajo-storage-hdfs tests occasionally hangs. (jhkim: rev a49c1a66035759da8ccd47c1da912afacc77b034) tajo-project/pom.xml CHANGES tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestByteBufLineReader.java tajo-cluster-tests/src/test/java/org/apache/tajo/TajoTestingCluster.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/HttpFileServerHandler.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/raw/TestDirectRawFile.java tajo-storage/tajo-storage-hdfs/src/test/java/org/apache/tajo/storage/TestFileTablespace.java tajo-core/pom.xml

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            jhkim Jinho Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development