[DERBY-4285] weme 6.1 apparent hang and subsequent Segmentation error running suites.All

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 10.5.2.0
• Component/s: Services
• Environment: weme 6.1 10.5.1.2.785874
• Urgency: Normal
• Bug behavior facts: Crash
• Assignee: Unassigned
• Reporter: Katherine Marsden
• Created: 22/Jun/09 16:50
• Updated: 19/Sep/09 15:20
• Resolved: 19/Sep/09 15:20

Description

I tried running weme 6.1 Suites.All on the 6-17 10.5 build (10.5.1.2.785874) since it didn't finish on the nightly machine before booting for the next day.

The run on my machine appeared to be hung and then when I pressed <ctrl> <break> I got:
a segmentation error. I forgot to start the tests with tracing but I think it was during the upgrade tests just hung trying to read a properties file on boot. I think it must have been upgrade because we have so many AntiGC threads. Maybe the nightlies were actually having the same problem before rebooting at 4:45.

Here is what I saw on my run after hitting <ctrl> <break>
unhandled exception
ype=Segmentation error vmState=0xffffffff
9Generic_Signal_Number=00000004 ExceptionCode=c0000005 ExceptionAddress=7FE6430E ContextFlags=0001003f
andler1=7FE50180 Handler2=7FD07A40 InaccessibleAddress=00000004
DI=415A8F00 ESI=0012FB8C EAX=00510438 EBX=FFFFFFFF
CX=415A8F00 EDX=4BC1FA74
IP=7FE6430E ESP=4BC1FA48 EBP=00000000
odule=c:\p4\marsden_trunk\weme6.1\bin\J9VM23.dll
odule_base_address=7FE30000 Offset_in_DLL=0003430e
arget=2_30_20061023_08962_lHdSMR (Windows XP 5.1 build 2600 Service Pack 2)
PU=x86 (2 logical CPUs) (0x7fe5b000 RAM)

avaVMInitArgs.nOptions=12:
-Dcom.ibm.oti.vm.exe=c:\p4\marsden_trunk\weme6.1\bin\j9.EXE
_port_library (extra info: 0012FB8C)
-Xjcl:jclfoun11_23
-DderbyTesting.serverhost=localhost
-DderbyTesting.clienthost=localhost
-Demma.active=
-Xbootclasspath/a:c:/p4/marsden_trunk/weme6.1/lib/jdbc.jar
-Dbootcp=c:/p4/marsden_trunk/weme6.1/lib/jdbc.jar
-Djava.home=c:/p4/marsden_trunk/weme6.1
-Dcom.ibm.oti.vm.bootstrap.library.path=c:\p4\marsden_trunk\weme6.1\bin\
-Djava.library.path=c:\p4\marsden_trunk\weme6.1\bin\;.;C:/software/ibm16/sdk/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4
marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4
marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:/p4/marsden_trunk/ibm16/bin;C:\Pr
gram Files\Apache Software Foundation\Maven 1.1\bin;C:\PROGRA~1\MKSTOO~1\bin;C:\PROGRA~1\MKSTOO~1\bin\X11;C:\PROGRA~1\M
STOO~1\mksnt;C:\Program Files\ThinkPad\Utilities;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Fil
s\IBM\Infoprint Select;C:\Notes;C:\Program Files\XLView;C:\lotus\compnent;C:\Utilities;C:\Program Files\IBM\Personal Co
munications\;C:\Program Files\IBM\Trace Facility\;C:\Program Files\ThinkPad\ConnectUtilities;C:\WINDOWS\Downloaded Prog
am Files;C:\Program Files\Subversion\bin;C:\svn\tools\ant\apache-ant-1.7.0\bin;c:\cygwin\home\kmarsden\emacs-21.3\bin;C
\Program Files\Perforce;C:\kmarsden\bin;C:\PROGRA~1\IBM\SQLLIB\BIN;C:\PROGRA~1\IBM\SQLLIB\FUNCTION;C:\PROGRA~1\IBM\SQLL
B\SAMPLES\REPL;CL\software\cmvc\bin;C:\Program Files\QuickTime\QTSystem\;C:\Program Files\IBM\CMVCDC50
-Djava.class.path=.;C:/kmarsden/projects/10.5beta/refresh/jars/derby.jar;C:/kmarsden/projects/10.5beta/refresh/jars/
erbytools.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbyrun.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbyn
t.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbyclient.jar;C:/kmarsden/projects/10.5beta/refresh/jars/derbytestin
.jar;C:/svn/tools/jakarta-oro-2.0.8.jar;C:/svn/tools/junit.jar

enerated system dump: C:\test5\user.dmp

hread: main (priority 5)
NATIVE java/net/SocketImpl.receiveStreamImpl(Ljava/io/FileDescriptor;[BIII)I
INLINED java/net/SocketImpl.read([BII)I (@4B596EDB)
00000103 java/net/SocketInputStream.read([BII)I (@4B596EDB)
000004ed java/io/BufferedInputStream.read([BII)I (@46D7B445)
0000006c com/ibm/oti/net/www/protocol/http/HttpURLConnection$LimitedInputStream.read([BII)I (@4B593CE4)
0000001d java/io/InputStream.read([B)I (@46DE9E19)
000000a7 com/ibm/oti/net/www/protocol/jar/JarURLConnection$3.run()Ljava/lang/Object; (@4B86C63B)
INLINED java/security/AccessController.doPrivileged(Ljava/security/PrivilegedAction;)Ljava/lang/Object; (@433D67FE)
000002a2 com/ibm/oti/net/www/protocol/jar/JarURLConnection.findJarFile()V (@433D67FE)
000000fa com/ibm/oti/net/www/protocol/jar/JarURLConnection.connect()V (@433D63D6)
00000008 com/ibm/oti/net/www/protocol/jar/JarURLConnection.getJarFile()Ljava/util/jar/JarFile;
00000be6 java/net/URLClassLoader.findResourceImpl([Ljava/net/URL;Ljava/lang/String;)Ljava/net/URL; (@4179BA42)
000001f5 java/net/URLClassLoader.findInExtensions([Ljava/net/URL;Ljava/lang/String;ILjava/util/Vector;Z)Ljava/lang/Obje
t; (@41744551)
0000006a java/net/URLClassLoader.findResources([Ljava/net/URL;Ljava/lang/String;Ljava/util/Vector;)Ljava/util/Vector;
00000016 java/net/URLClassLoader$1.run()Ljava/lang/Object;
00000003 java/security/AccessController.doPrivileged(Ljava/security/PrivilegedAction;Ljava/security/AccessControlContex
;)Ljava/lang/Object;
00000013 java/net/URLClassLoader.findResources(Ljava/lang/String;)Ljava/util/Enumeration;
0000000c java/lang/ClassLoader.getResources(Ljava/lang/String;)Ljava/util/Enumeration;
00000021 org/apache/derby/impl/services/monitor/BaseMonitor.getDefaultModuleProperties()Ljava/util/Properties;
00000049 org/apache/derby/impl/services/monitor/FileMonitor.run()Ljava/lang/Object;
0000003e java/security/AccessController.doPrivileged(Ljava/security/PrivilegedExceptionAction;)Ljava/lang/Object; (@46
658FA)
00000006 org/apache/derby/impl/services/monitor/FileMonitor.getDefaultModuleProperties()Ljava/util/Properties;
00000001 org/apache/derby/impl/services/monitor/BaseMonitor.getDefaultImplementations()Ljava/util/Vector;
0000008b org/apache/derby/impl/services/monitor/BaseMonitor.runWithState(Ljava/util/Properties;Ljava/io/PrintStream;)V
00000007 org/apache/derby/impl/services/monitor/FileMonitor.<init>(Ljava/util/Properties;Ljava/io/PrintStream;)V
00000006 org/apache/derby/iapi/services/monitor/Monitor.startMonitor(Ljava/util/Properties;Ljava/io/PrintStream;)V
0000001b org/apache/derby/iapi/jdbc/JDBCBoot.boot(Ljava/lang/String;Ljava/io/PrintStream;)V
00000039 org/apache/derby/jdbc/EmbeddedSimpleDataSource.findDriver()Lorg/apache/derby/jdbc/InternalDriver;
00000041 org/apache/derby/jdbc/EmbeddedSimpleDataSource.getConnection(Ljava/lang/String;Ljava/lang/String;)Ljava/sql/Co
nection;
00000009 org/apache/derby/jdbc/EmbeddedSimpleDataSource.getConnection()Ljava/sql/Connection;
0000010e org/apache/derbyTesting/functionTests/tests/upgradeTests/PhaseChanger.setUp()V
00000004 junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
0000003e junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V (@47157BFA)
000000f1 junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V (@46F84DAD)
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000014 org/apache/derbyTesting/junit/BaseTestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
00000007 junit/extensions/TestDecorator.basicRun(Ljunit/framework/TestResult;)V
0000000f junit/extensions/TestSetup$1.protect()V
0000002f junit/framework/TestResult.runProtected(Ljunit/framework/Test;Ljunit/framework/Protectable;)V (@4715734B)
0000000d junit/extensions/TestSetup.run(Ljunit/framework/TestResult;)V
0000003e junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V (@47157BFA)
000000f1 junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V (@46F84DAD)
0000002f junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V (@47157BEB)
0000001f junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V
00000004 junit/framework/TestSuite.runTest(Ljunit/framework/Test;Ljunit/framework/TestResult;)V
0000001f junit/framework/TestSuite.run(Ljunit/framework/TestResult;)V
00000016 junit/textui/TestRunner.doRun(Ljunit/framework/Test;Z)Ljunit/framework/TestResult;
00000090 junit/textui/TestRunner.start([Ljava/lang/String;)Ljunit/framework/TestResult;
0000000a junit/textui/TestRunner.main([Ljava/lang/String;)V

hread: JIT Compilation Thread (priority 10) (daemon)

hread: Gc Slave Thread (priority 5) (daemon)

hread: Finalizer thread (priority 5) (daemon)

hread: derby.antiGC (priority 1) (daemon)
NATIVE java/lang/Object.wait(JI)V
00000019 java/lang/Object.wait()V (@4B218E95)
0000000f org/apache/derby/impl/services/monitor/AntiGC.run()V
0000000d java/lang/Thread.run()V

hread: Thread-182 (priority 5) (daemon)
NATIVE java/lang/Object.wait(JI)V
00000019 java/lang/Object.wait()V (@4B218E95)
00000023 java/util/Timer$TimerImpl.run()V

hread: derby.rawStoreDaemon (priority 5) (daemon)
NATIVE java/lang/Object.wait(JI)V
INLINED java/lang/Object.wait(J)V (@46B92AA9)
0000004d org/apache/derby/impl/services/daemon/BasicDaemon.rest()Z (@46B92AA9)
00000062 org/apache/derby/impl/services/daemon/BasicDaemon.run()V (@46DD45DE)
0000000d java/lang/Thread.run()V

hread: derby.antiGC (priority 1) (daemon)
NATIVE java/lang/Object.wait(JI)V
00000019 java/lang/Object.wait()V (@4B218E95)
00000014 org/apache/derby/impl/services/monitor/AntiGC.run()V
0000000d java/lang/Thread.run()V

hread: derby.antiGC (priority 1) (daemon)
NATIVE java/lang/Object.wait(JI)V
00000019 java/lang/Object.wait()V (@4B218E95)
00000014 org/apache/derby/impl/services/monitor/AntiGC.run()V
0000000d java/lang/Thread.run()V

hread: derby.antiGC (priority 1) (daemon)
NATIVE java/lang/Object.wait(JI)V
00000019 java/lang/Object.wait()V (@4B218E95)
00000014 org/apache/derby/impl/services/monitor/AntiGC.run()V
0000000d java/lang/Thread.run()V

hread: derby.antiGC (priority 1) (daemon)
NATIVE java/lang/Object.wait(JI)V
00000019 java/lang/Object.wait()V (@4B218E95)
0000000f org/apache/derby/impl/services/monitor/AntiGC.run()V
0000000d java/lang/Thread.run()V

a subsequent weme 6.1 run on my machine with the same build passed except for an instance of DERBY-4261. Here is the recent 10.5 weme 6.1 nightly run history.
6-12-2009 10.5.1.2 - (783964) - full and clean run.
6-13-2009 no run
6-14-2009 no run
6-15-2009 did not get to weme 6.1 (ibm15 run hung with DERBY-4053)
6-16-2009 10.5.1.2 - (785466) apparent hang. Last test started testMixedInsertDelete
6-17-2009 10.5.1.2 - (785874) apparent hang. Last test started testPolishCollation
6-18-2009 10.5.1.2 - (786353) apparent hang. Last test started testMixedInsertDelet
6-19-2009 no run
6-20-2009 no run