Derby
  1. Derby
  2. DERBY-4285

weme 6.1 apparent hang and subsequent Segmentation error running suites.All

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: 10.5.2.0
    • Fix Version/s: None
    • Component/s: Services
    • Labels:
      None
    • Environment:
      weme 6.1 10.5.1.2.785874
    • Urgency:
      Normal
    • Bug behavior facts:
      Crash

      Description

      I tried running weme 6.1 Suites.All on the 6-17 10.5 build (10.5.1.2.785874) since it didn't finish on the nightly machine before booting for the next day.

      The run on my machine appeared to be hung and then when I pressed <ctrl> <break> I got:
      a segmentation error. I forgot to start the tests with tracing but I think it was during the upgrade tests just hung trying to read a properties file on boot. I think it must have been upgrade because we have so many AntiGC threads. Maybe the nightlies were actually having the same problem before rebooting at 4:45.

      Here is what I saw on my run after hitting <ctrl> <break>
      unhandled exception
      ype=Segmentation error vmState=0xffffffff
      9Generic_Signal_Number=00000004 ExceptionCode=c0000005 ExceptionAddress=7FE6430E ContextFlags=0001003f
      andler1=7FE50180 Handler2=7FD07A40 InaccessibleAddress=00000004
      DI=415A8F00 ESI=0012FB8C EAX=00510438 EBX=FFFFFFFF
      CX=415A8F00 EDX=4BC1FA74
      IP=7FE6430E ESP=4BC1FA48 EBP=00000000
      odule=c:\p4\marsden_trunk\weme6.1\bin\J9VM23.dll
      odule_base_address=7FE30000 Offset_in_DLL=0003430e
      arget=2_30_20061023_08962_lHdSMR (Windows XP 5.1 build 2600 Service Pack 2)
      PU=x86 (2 logical CPUs) (0x7fe5b000 RAM)

      avaVMInitArgs.nOptions=12:
      -Dcom.ibm.oti.vm.exe=c:\p4\marsden_trunk\weme6.1\bin\j9.EXE
      _port_library (extra info: 0012FB8C)
      -Xjcl:jclfoun11_23
      -DderbyTesting.serverhost=localhost
      -DderbyTesting.clienthost=localhost
      -Demma.active=
      -Xbootclasspath/a:c:/p4/marsden_trunk/weme6.1/lib/jdbc.jar
      -Dbootcp=c:/p4/marsden_trunk/weme6.1/lib/jdbc.jar
      -Djava.home=c:/p4/marsden_trunk/weme6.1
      -Dcom.ibm.oti.vm.bootstrap.library.path=c:\p4\marsden_trunk\weme6.1\bin\
      -Djava.library.path=c:\p4\marsden_trunk\weme6.1\bin\;.;C:/software/ibm16/sdk/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4
      marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4
      marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:\Pr
      gram Files\Apache Software Foundation\Maven 1.1\bin;C:\PROGRA~1\MKSTOO~1\bin;C:\PROGRA~1\MKSTOO~1\bin\X11;C:\PROGRA~1\M
      STOO~1\mksnt;C:\Program Files\ThinkPad\Utilities;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Fil
      s\IBM\Infoprint Select;C:\Notes;C:\Program Files\XLView;C:\lotus\compnent;C:\Utilities;C:\Program Files\IBM\Personal Co
      munications\;C:\Program Files\IBM\Trace Facility\;C:\Program Files\ThinkPad\ConnectUtilities;C:\WINDOWS\Downloaded Prog
      am Files;C:\Program Files\Subversion\bin;C:\svn\tools\ant\apache-ant-1.7.0\bin;c:\cygwin\home\kmarsden\emacs-21.3\bin;C
      \Program Files\Perforce;C:\kmarsden\bin;C:\PROGRA~1\IBM\SQLLIB\BIN;C:\PROGRA~1\IBM\SQLLIB\FUNCTION;C:\PROGRA~1\IBM\SQLL
      B\SAMPLES\REPL;CL\software\cmvc\bin;C:\Program Files\QuickTime\QTSystem\;C:\Program Files\IBM\CMVCDC50
      -Djava.class.path=.;C:/kmarsden/projects/10.5beta/refresh/jars/derby.jar;C:/kmarsden/projects/10.5beta/refresh/jars/
      erbytools.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbyrun.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbyn
      t.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbyclient.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbytestin
      .jar;C:/svn/tools/jakarta-oro-2.0.8.jar;C:/svn/tools/junit.jar

      enerated system dump: C:\test5\user.dmp

      hread: main (priority 5)
      NATIVE java/net/SocketImpl.receiveStreamImpl(Ljava/io/FileDescriptor;[BIII)I
      INLINED java/net/SocketImpl.read([BII)I (@4B596EDB)
      00000103 java/net/SocketInputStream.read([BII)I (@4B596EDB)
      000004ed java/io/BufferedInputStream.read([BII)I (@46D7B445)
      0000006c com/ibm/oti/net/www/protocol/http/HttpURLConnection$LimitedInputStream.read([BII)I (@4B593CE4)
      0000001d java/io/InputStream.read([B)I (@46DE9E19)
      000000a7 com/ibm/oti/net/www/protocol/jar/JarURLConnection$3.run()Ljava/lang/Object; (@4B86C63B)
      INLINED java/security/AccessController.doPrivileged(Ljava/security/PrivilegedAction;)Ljava/lang/Object; (@433D67FE)
      000002a2 com/ibm/oti/net/www/protocol/jar/JarURLConnection.findJarFile()V (@433D67FE)
      000000fa com/ibm/oti/net/www/protocol/jar/JarURLConnection.connect()V (@433D63D6)
      00000008 com/ibm/oti/net/www/protocol/jar/JarURLConnection.getJarFile()Ljava/util/jar/JarFile;
      00000be6 java/net/URLClassLoader.findResourceImpl([Ljava/net/URL;Ljava/lang/String;)Ljava/net/URL; (@4179BA42)
      000001f5 java/net/URLClassLoader.findInExtensions([Ljava/net/URL;Ljava/lang/String;ILjava/util/Vector;Z)Ljava/lang/Obje
      t; (@41744551)
      0000006a java/net/URLClassLoader.findResources([Ljava/net/URL;Ljava/lang/String;Ljava/util/Vector;)Ljava/util/Vector;
      00000016 java/net/URLClassLoader$1.run()Ljava/lang/Object;
      00000003 java/security/AccessController.doPrivileged(Ljava/security/PrivilegedAction;Ljava/security/AccessControlContex
      ;)Ljava/lang/Object;
      00000013 java/net/URLClassLoader.findResources(Ljava/lang/String;)Ljava/util/Enumeration;
      0000000c java/lang/ClassLoader.getResources(Ljava/lang/String;)Ljava/util/Enumeration;
      00000021 org/apache/derby/impl/services/monitor/BaseMonitor.getDefaultModuleProperties()Ljava/util/Properties;
      00000049 org/apache/derby/impl/services/monitor/FileMonitor.run()Ljava/lang/Object;
      0000003e java/security/AccessController.doPrivileged(Ljava/security/PrivilegedExceptionAction;)Ljava/lang/Object; (@46
      658FA)
      00000006 org/apache/derby/impl/services/monitor/FileMonitor.getDefaultModuleProperties()Ljava/util/Properties;
      00000001 org/apache/derby/impl/services/monitor/BaseMonitor.getDefaultImplementations()Ljava/util/Vector;
      0000008b org/apache/derby/impl/services/monitor/BaseMonitor.runWithState(Ljava/util/Properties;Ljava/io/PrintStream;)V
      00000007 org/apache/derby/impl/services/monitor/FileMonitor.<init>(Ljava/util/Properties;Ljava/io/PrintStream;)V
      00000006 org/apache/derby/iapi/services/monitor/Monitor.startMonitor(Ljava/util/Properties;Ljava/io/PrintStream;)V
      0000001b org/apache/derby/iapi/jdbc/JDBCBoot.boot(Ljava/lang/String;Ljava/io/PrintStream;)V
      00000039 org/apache/derby/jdbc/EmbeddedSimpleDataSource.findDriver()Lorg/apache/derby/jdbc/InternalDriver;
      00000041 org/apache/derby/jdbc/EmbeddedSimpleDataSource.getConnection(Ljava/lang/String;Ljava/lang/String;)Ljava/sql/Co
      nection;
      00000009 org/apache/derby/jdbc/EmbeddedSimpleDataSource.getConnection()Ljava/sql/Connection;
      0000010e org/apache/derbyTesting/functionTests/tests/upgradeTests/PhaseChanger.setUp()V
      00000004 junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
      0000003e junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V (@47157BFA)
      000000f1 junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V (@46F84DAD)
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
      0000000f junit/extensions/TestSetup$1.protect()V
      0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
      0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
      0000003e junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V (@47157BFA)
      000000f1 junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V (@46F84DAD)
      0000002f junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V (@47157BEB)
      0000001f junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V
      00000004 junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V
      0000001f junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V
      00000016 junit/textui/TestRunner.doRun(Ljunit/framework/Test;Z)Ljunit/framework/TestResult;
      00000090 junit/textui/TestRunner.start([Ljava/lang/String;)Ljunit/framework/TestResult;
      0000000a junit/textui/TestRunner.main([Ljava/lang/String;)V

      hread: JIT Compilation Thread (priority 10) (daemon)

      hread: Gc Slave Thread (priority 5) (daemon)

      hread: Finalizer thread (priority 5) (daemon)

      hread: derby.antiGC (priority 1) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      00000019 java/lang/Object.wait()V (@4B218E95)
      0000000f org/apache/derby/impl/services/monitor/AntiGC.run()V
      0000000d java/lang/Thread.run()V

      hread: Thread-182 (priority 5) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      00000019 java/lang/Object.wait()V (@4B218E95)
      00000023 java/util/Timer$TimerImpl.run()V

      hread: derby.rawStoreDaemon (priority 5) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      INLINED java/lang/Object.wait(J)V (@46B92AA9)
      0000004d org/apache/derby/impl/services/daemon/BasicDaemon.rest()Z (@46B92AA9)
      00000062 org/apache/derby/impl/services/daemon/BasicDaemon.run()V (@46DD45DE)
      0000000d java/lang/Thread.run()V

      hread: derby.antiGC (priority 1) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      00000019 java/lang/Object.wait()V (@4B218E95)
      00000014 org/apache/derby/impl/services/monitor/AntiGC.run()V
      0000000d java/lang/Thread.run()V

      hread: derby.antiGC (priority 1) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      00000019 java/lang/Object.wait()V (@4B218E95)
      00000014 org/apache/derby/impl/services/monitor/AntiGC.run()V
      0000000d java/lang/Thread.run()V

      hread: derby.antiGC (priority 1) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      00000019 java/lang/Object.wait()V (@4B218E95)
      00000014 org/apache/derby/impl/services/monitor/AntiGC.run()V
      0000000d java/lang/Thread.run()V

      hread: derby.antiGC (priority 1) (daemon)
      NATIVE java/lang/Object.wait(JI)V
      00000019 java/lang/Object.wait()V (@4B218E95)
      0000000f org/apache/derby/impl/services/monitor/AntiGC.run()V
      0000000d java/lang/Thread.run()V

      a subsequent weme 6.1 run on my machine with the same build passed except for an instance of DERBY-4261. Here is the recent 10.5 weme 6.1 nightly run history.
      6-12-2009 10.5.1.2 - (783964) - full and clean run.
      6-13-2009 no run
      6-14-2009 no run
      6-15-2009 did not get to weme 6.1 (ibm15 run hung with DERBY-4053)
      6-16-2009 10.5.1.2 - (785466) apparent hang. Last test started testMixedInsertDelete
      6-17-2009 10.5.1.2 - (785874) apparent hang. Last test started testPolishCollation
      6-18-2009 10.5.1.2 - (786353) apparent hang. Last test started testMixedInsertDelet
      6-19-2009 no run
      6-20-2009 no run

        Activity

        Hide
        Myrna van Lunteren added a comment -

        Closing, we're assuming it was a jvm issue of some sort, and fixed somehow by the next release.

        Show
        Myrna van Lunteren added a comment - Closing, we're assuming it was a jvm issue of some sort, and fixed somehow by the next release.
        Hide
        Kathey Marsden added a comment -

        I ran with weme 6.2.2 and did not see the issue. Since there was a JVM crash, I think we can safely assume this was a JVM issue and close it invalid.

        Show
        Kathey Marsden added a comment - I ran with weme 6.2.2 and did not see the issue. Since there was a JVM crash, I think we can safely assume this was a JVM issue and close it invalid.
        Hide
        Myrna van Lunteren added a comment -

        weme6.1 was pretty old. Have you tried a run with weme6.2?
        I ran suites.All with 10.5.20 (insane jars) on my machine with weme 6.2 and there was no problem...
        I have to add, I also ran with 10.5.20 (insane jars) on my machine with weme 6.1 and there was no problem there either.

        Show
        Myrna van Lunteren added a comment - weme6.1 was pretty old. Have you tried a run with weme6.2? I ran suites.All with 10.5.20 (insane jars) on my machine with weme 6.2 and there was no problem... I have to add, I also ran with 10.5.20 (insane jars) on my machine with weme 6.1 and there was no problem there either.
        Hide
        Dag H. Wanvik added a comment -

        Triaged for 10.5.2. Perhaps this should be marked as "crash"; leaving that call to reporter.
        Setting normal urgency.

        Show
        Dag H. Wanvik added a comment - Triaged for 10.5.2. Perhaps this should be marked as "crash"; leaving that call to reporter. Setting normal urgency.
        Hide
        Kathey Marsden added a comment -

        I should have noted that while the run I mention in this issue was definitely stalled (no progression for over 12 hours) the nightly runs may have just run out of time before the machine booted for the next day. I still need to investigate that.

        Show
        Kathey Marsden added a comment - I should have noted that while the run I mention in this issue was definitely stalled (no progression for over 12 hours) the nightly runs may have just run out of time before the machine booted for the next day. I still need to investigate that.

          People

          • Assignee:
            Unassigned
            Reporter:
            Kathey Marsden
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development