Lucene - Core
  1. Lucene - Core
  2. LUCENE-3869

possible hang in UIMATypeAwareAnalyzerTest

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 4.0-ALPHA
    • Fix Version/s: None
    • Component/s: modules/analysis
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Just testing an unrelated patch, I was hung (with 100% cpu) in UIMATypeAwareAnalyzerTest.

      I'll attach stacktrace at the moment of the hang.

      The fact we get a seed in the actual stacktraces for cases like this is awesome! Thanks Dawid!
      I don't think it reproduces 100%, but I'll try beasting this seed to see if i can reproduce the hang:

      should be 'ant test -Dtestcase=UIMATypeAwareAnalyzerTest -Dtests.seed=-262aada3325aa87a:-44863926cf5c87e9:5c8c471d901b98bd'
      from what I can see.

        Activity

        Hide
        Robert Muir added a comment -

        Stacktrace:

        junit-sequential:
            [junit] Testsuite: org.apache.lucene.analysis.uima.UIMABaseAnalyzerTest
            [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.603 sec
            [junit] 
            [junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest
            [junit] 2012-03-14 10:42:27
            [junit] Full thread dump Java HotSpot(TM) 64-Bit Server VM (19.1-b02 mixed mode):
            [junit] 
            [junit] "Thread-9" prio=10 tid=0x00007f3ba44af000 nid=0x34d1 runnable [0x00007f3ba3a72000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 	at java.util.HashMap.transfer(HashMap.java:484)
            [junit] 	at java.util.HashMap.resize(HashMap.java:463)
            [junit] 	at java.util.HashMap.addEntry(HashMap.java:755)
            [junit] 	at java.util.HashMap.put(HashMap.java:385)
            [junit] 	at java.util.HashSet.add(HashSet.java:200)
            [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineManagementImpl.setName(AnalysisEngineManagementImpl.java:245)
            [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.initialize(AnalysisEngineImplBase.java:181)
            [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.initialize(AggregateAnalysisEngine_impl.java:127)
            [junit] 	at org.apache.uima.impl.AnalysisEngineFactory_impl.produceResource(AnalysisEngineFactory_impl.java:94)
            [junit] 	at org.apache.uima.impl.CompositeResourceFactory_impl.produceResource(CompositeResourceFactory_impl.java:62)
            [junit] 	at org.apache.uima.UIMAFramework.produceResource(UIMAFramework.java:267)
            [junit] 	at org.apache.uima.UIMAFramework.produceAnalysisEngine(UIMAFramework.java:335)
            [junit] 	at org.apache.lucene.analysis.uima.ae.BasicAEProvider.getAE(BasicAEProvider.java:73)
            [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.<init>(BaseUIMATokenizer.java:45)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.<init>(UIMATypeAwareAnnotationsTokenizer.java:54)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzer.createComponents(UIMATypeAwareAnalyzer.java:40)
            [junit] 	at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:83)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:368)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:338)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:330)
            [junit] 
            [junit] "Low Memory Detector" daemon prio=10 tid=0x0000000041a0d000 nid=0x34c7 runnable [0x0000000000000000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 
            [junit] "CompilerThread1" daemon prio=10 tid=0x0000000041a0a800 nid=0x34c6 waiting on condition [0x0000000000000000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 
            [junit] "CompilerThread0" daemon prio=10 tid=0x0000000041a08000 nid=0x34c5 waiting on condition [0x0000000000000000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 
            [junit] "Signal Dispatcher" daemon prio=10 tid=0x0000000041a05800 nid=0x34c4 waiting on condition [0x0000000000000000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 
            [junit] "Finalizer" daemon prio=10 tid=0x00000000419e9000 nid=0x34c3 in Object.wait() [0x00007f3ba0920000]
            [junit]    java.lang.Thread.State: WAITING (on object monitor)
            [junit] 	at java.lang.Object.wait(Native Method)
            [junit] 	- waiting on <0x00000000e6920d88> (a java.lang.ref.ReferenceQueue$Lock)
            [junit] 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
            [junit] 	- locked <0x00000000e6920d88> (a java.lang.ref.ReferenceQueue$Lock)
            [junit] 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
            [junit] 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
            [junit] 
            [junit] "Reference Handler" daemon prio=10 tid=0x00000000419e6800 nid=0x34c2 in Object.wait() [0x00007f3ba8a21000]
            [junit]    java.lang.Thread.State: WAITING (on object monitor)
            [junit] 	at java.lang.Object.wait(Native Method)
            [junit] 	- waiting on <0x00000000e6920d20> (a java.lang.ref.Reference$Lock)
            [junit] 	at java.lang.Object.wait(Object.java:485)
            [junit] 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
            [junit] 	- locked <0x00000000e6920d20> (a java.lang.ref.Reference$Lock)
            [junit] 
            [junit] "LTC-main#seed=-262aada3325aa87a:-44863926cf5c87e9:5c8c471d901b98bd" prio=10 tid=0x000000004197a800 nid=0x34b8 in Object.wait() [0x00007f3badfc6000]
            [junit]    java.lang.Thread.State: WAITING (on object monitor)
            [junit] 	at java.lang.Object.wait(Native Method)
            [junit] 	- waiting on <0x00000000e9350b58> (a org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread)
            [junit] 	at java.lang.Thread.join(Thread.java:1186)
            [junit] 	- locked <0x00000000e9350b58> (a org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread)
            [junit] 	at java.lang.Thread.join(Thread.java:1239)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:305)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:285)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest.testRandomStrings(UIMATypeAwareAnalyzerTest.java:63)
            [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
            [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
            [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
            [junit] 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
            [junit] 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
            [junit] 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
            [junit] 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
            [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
            [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
            [junit] 	at org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:729)
            [junit] 	at org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:645)
            [junit] 	at org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
            [junit] 	at org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:556)
            [junit] 	at org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:51)
            [junit] 	at org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:618)
            [junit] 	at org.junit.rules.RunRules.evaluate(RunRules.java:18)
            [junit] 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
            [junit] 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
            [junit] 	at org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:164)
            [junit] 	at org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:57)
            [junit] 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
            [junit] 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
            [junit] 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
            [junit] 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
            [junit] 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
            [junit] 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
            [junit] 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
            [junit] 	at org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:51)
            [junit] 	at org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:21)
            [junit] 	at org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22)
            [junit] 	at org.junit.rules.RunRules.evaluate(RunRules.java:18)
            [junit] 	at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
            [junit] 	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
            [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
            [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
            [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:743)
            [junit] 
            [junit] "VM Thread" prio=10 tid=0x00000000419e0000 nid=0x34c1 runnable 
            [junit] 
            [junit] "GC task thread#0 (ParallelGC)" prio=10 tid=0x000000004198d800 nid=0x34b9 runnable 
            [junit] 
            [junit] "GC task thread#1 (ParallelGC)" prio=10 tid=0x000000004198f800 nid=0x34ba runnable 
            [junit] 
            [junit] "GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000041991800 nid=0x34bb runnable 
            [junit] 
            [junit] "GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000041993000 nid=0x34bc runnable 
            [junit] 
            [junit] "GC task thread#4 (ParallelGC)" prio=10 tid=0x0000000041995000 nid=0x34bd runnable 
            [junit] 
            [junit] "GC task thread#5 (ParallelGC)" prio=10 tid=0x0000000041997000 nid=0x34be runnable 
            [junit] 
            [junit] "GC task thread#6 (ParallelGC)" prio=10 tid=0x0000000041998800 nid=0x34bf runnable 
            [junit] 
            [junit] "GC task thread#7 (ParallelGC)" prio=10 tid=0x000000004199a800 nid=0x34c0 runnable 
            [junit] 
            [junit] "VM Periodic Task Thread" prio=10 tid=0x0000000041a20000 nid=0x34c8 waiting on condition 
            [junit] 
            [junit] JNI global references: 1343
            [junit] 
            [junit] Heap
            [junit]  PSYoungGen      total 116480K, used 5575K [0x00000000f5560000, 0x0000000100000000, 0x0000000100000000)
            [junit]   eden space 58240K, 9% used [0x00000000f5560000,0x00000000f5a89d50,0x00000000f8e40000)
            [junit]   from space 58240K, 0% used [0x00000000f8e40000,0x00000000f8e88000,0x00000000fc720000)
            [junit]   to   space 58240K, 0% used [0x00000000fc720000,0x00000000fc720000,0x0000000100000000)
            [junit]  PSOldGen        total 299776K, used 163822K [0x00000000e0000000, 0x00000000f24c0000, 0x00000000f5560000)
            [junit]   object space 299776K, 54% used [0x00000000e0000000,0x00000000e9ffb930,0x00000000f24c0000)
            [junit]  PSPermGen       total 33600K, used 17723K [0x00000000dae00000, 0x00000000dced0000, 0x00000000e0000000)
            [junit]   object space 33600K, 52% used [0x00000000dae00000,0x00000000dbf4ee90,0x00000000dced0000)
        
        Show
        Robert Muir added a comment - Stacktrace: junit-sequential: [junit] Testsuite: org.apache.lucene.analysis.uima.UIMABaseAnalyzerTest [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 4.603 sec [junit] [junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest [junit] 2012-03-14 10:42:27 [junit] Full thread dump Java HotSpot(TM) 64-Bit Server VM (19.1-b02 mixed mode): [junit] [junit] "Thread-9" prio=10 tid=0x00007f3ba44af000 nid=0x34d1 runnable [0x00007f3ba3a72000] [junit] java.lang.Thread.State: RUNNABLE [junit] at java.util.HashMap.transfer(HashMap.java:484) [junit] at java.util.HashMap.resize(HashMap.java:463) [junit] at java.util.HashMap.addEntry(HashMap.java:755) [junit] at java.util.HashMap.put(HashMap.java:385) [junit] at java.util.HashSet.add(HashSet.java:200) [junit] at org.apache.uima.analysis_engine.impl.AnalysisEngineManagementImpl.setName(AnalysisEngineManagementImpl.java:245) [junit] at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.initialize(AnalysisEngineImplBase.java:181) [junit] at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.initialize(AggregateAnalysisEngine_impl.java:127) [junit] at org.apache.uima.impl.AnalysisEngineFactory_impl.produceResource(AnalysisEngineFactory_impl.java:94) [junit] at org.apache.uima.impl.CompositeResourceFactory_impl.produceResource(CompositeResourceFactory_impl.java:62) [junit] at org.apache.uima.UIMAFramework.produceResource(UIMAFramework.java:267) [junit] at org.apache.uima.UIMAFramework.produceAnalysisEngine(UIMAFramework.java:335) [junit] at org.apache.lucene.analysis.uima.ae.BasicAEProvider.getAE(BasicAEProvider.java:73) [junit] at org.apache.lucene.analysis.uima.BaseUIMATokenizer.<init>(BaseUIMATokenizer.java:45) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.<init>(UIMATypeAwareAnnotationsTokenizer.java:54) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzer.createComponents(UIMATypeAwareAnalyzer.java:40) [junit] at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:83) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:368) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:338) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:330) [junit] [junit] "Low Memory Detector" daemon prio=10 tid=0x0000000041a0d000 nid=0x34c7 runnable [0x0000000000000000] [junit] java.lang.Thread.State: RUNNABLE [junit] [junit] "CompilerThread1" daemon prio=10 tid=0x0000000041a0a800 nid=0x34c6 waiting on condition [0x0000000000000000] [junit] java.lang.Thread.State: RUNNABLE [junit] [junit] "CompilerThread0" daemon prio=10 tid=0x0000000041a08000 nid=0x34c5 waiting on condition [0x0000000000000000] [junit] java.lang.Thread.State: RUNNABLE [junit] [junit] "Signal Dispatcher" daemon prio=10 tid=0x0000000041a05800 nid=0x34c4 waiting on condition [0x0000000000000000] [junit] java.lang.Thread.State: RUNNABLE [junit] [junit] "Finalizer" daemon prio=10 tid=0x00000000419e9000 nid=0x34c3 in Object.wait() [0x00007f3ba0920000] [junit] java.lang.Thread.State: WAITING (on object monitor) [junit] at java.lang.Object.wait(Native Method) [junit] - waiting on <0x00000000e6920d88> (a java.lang.ref.ReferenceQueue$Lock) [junit] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) [junit] - locked <0x00000000e6920d88> (a java.lang.ref.ReferenceQueue$Lock) [junit] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134) [junit] at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) [junit] [junit] "Reference Handler" daemon prio=10 tid=0x00000000419e6800 nid=0x34c2 in Object.wait() [0x00007f3ba8a21000] [junit] java.lang.Thread.State: WAITING (on object monitor) [junit] at java.lang.Object.wait(Native Method) [junit] - waiting on <0x00000000e6920d20> (a java.lang.ref.Reference$Lock) [junit] at java.lang.Object.wait(Object.java:485) [junit] at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) [junit] - locked <0x00000000e6920d20> (a java.lang.ref.Reference$Lock) [junit] [junit] "LTC-main#seed=-262aada3325aa87a:-44863926cf5c87e9:5c8c471d901b98bd" prio=10 tid=0x000000004197a800 nid=0x34b8 in Object.wait() [0x00007f3badfc6000] [junit] java.lang.Thread.State: WAITING (on object monitor) [junit] at java.lang.Object.wait(Native Method) [junit] - waiting on <0x00000000e9350b58> (a org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread) [junit] at java.lang.Thread.join(Thread.java:1186) [junit] - locked <0x00000000e9350b58> (a org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread) [junit] at java.lang.Thread.join(Thread.java:1239) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:305) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:285) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest.testRandomStrings(UIMATypeAwareAnalyzerTest.java:63) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) [junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) [junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) [junit] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28) [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30) [junit] at org.apache.lucene.util.LuceneTestCase$SubclassSetupTeardownRule$1.evaluate(LuceneTestCase.java:729) [junit] at org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:645) [junit] at org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22) [junit] at org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:556) [junit] at org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:51) [junit] at org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:618) [junit] at org.junit.rules.RunRules.evaluate(RunRules.java:18) [junit] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263) [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68) [junit] at org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:164) [junit] at org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:57) [junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) [junit] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60) [junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229) [junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50) [junit] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222) [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28) [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30) [junit] at org.apache.lucene.util.UncaughtExceptionsRule$1.evaluate(UncaughtExceptionsRule.java:51) [junit] at org.apache.lucene.util.StoreClassNameRule$1.evaluate(StoreClassNameRule.java:21) [junit] at org.apache.lucene.util.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:22) [junit] at org.junit.rules.RunRules.evaluate(RunRules.java:18) [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:300) [junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:743) [junit] [junit] "VM Thread" prio=10 tid=0x00000000419e0000 nid=0x34c1 runnable [junit] [junit] "GC task thread#0 (ParallelGC)" prio=10 tid=0x000000004198d800 nid=0x34b9 runnable [junit] [junit] "GC task thread#1 (ParallelGC)" prio=10 tid=0x000000004198f800 nid=0x34ba runnable [junit] [junit] "GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000041991800 nid=0x34bb runnable [junit] [junit] "GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000041993000 nid=0x34bc runnable [junit] [junit] "GC task thread#4 (ParallelGC)" prio=10 tid=0x0000000041995000 nid=0x34bd runnable [junit] [junit] "GC task thread#5 (ParallelGC)" prio=10 tid=0x0000000041997000 nid=0x34be runnable [junit] [junit] "GC task thread#6 (ParallelGC)" prio=10 tid=0x0000000041998800 nid=0x34bf runnable [junit] [junit] "GC task thread#7 (ParallelGC)" prio=10 tid=0x000000004199a800 nid=0x34c0 runnable [junit] [junit] "VM Periodic Task Thread" prio=10 tid=0x0000000041a20000 nid=0x34c8 waiting on condition [junit] [junit] JNI global references: 1343 [junit] [junit] Heap [junit] PSYoungGen total 116480K, used 5575K [0x00000000f5560000, 0x0000000100000000, 0x0000000100000000) [junit] eden space 58240K, 9% used [0x00000000f5560000,0x00000000f5a89d50,0x00000000f8e40000) [junit] from space 58240K, 0% used [0x00000000f8e40000,0x00000000f8e88000,0x00000000fc720000) [junit] to space 58240K, 0% used [0x00000000fc720000,0x00000000fc720000,0x0000000100000000) [junit] PSOldGen total 299776K, used 163822K [0x00000000e0000000, 0x00000000f24c0000, 0x00000000f5560000) [junit] object space 299776K, 54% used [0x00000000e0000000,0x00000000e9ffb930,0x00000000f24c0000) [junit] PSPermGen total 33600K, used 17723K [0x00000000dae00000, 0x00000000dced0000, 0x00000000e0000000) [junit] object space 33600K, 52% used [0x00000000dae00000,0x00000000dbf4ee90,0x00000000dced0000)
        Hide
        Tommaso Teofili added a comment -

        Thanks Robert, I'm taking a look

        Show
        Tommaso Teofili added a comment - Thanks Robert, I'm taking a look
        Hide
        Robert Muir added a comment -

        If you try this seed a lot of times, eventually it will reproduce.

        I tried adding -Dtests.iter=10 to my command-line,
        so 'ant test -Dtestcase=UIMATypeAwareAnalyzerTest -Dtests.seed=-262aada3325aa87a:-44863926cf5c87e9:5c8c471d901b98bd -Dtests.iter=10'

        after about 3 or 4 runs it hung... though interestingly it hung at 200% cpu usage (as if two of the analysis threads were stuck).

        Stacktrace is in the same place, just for both threads:

            [junit] "Thread-48" prio=10 tid=0x00007fbec0b9c000 nid=0x4979 runnable [0x00007fbebfa7d000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 	at java.util.HashMap.getEntry(HashMap.java:347)
            [junit] 	at java.util.HashMap.containsKey(HashMap.java:335)
            [junit] 	at java.util.HashSet.contains(HashSet.java:184)
            [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineManagementImpl.setName(AnalysisEngineManagementImpl.java:242)
            [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.initialize(AnalysisEngineImplBase.java:181)
            [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.initialize(AggregateAnalysisEngine_impl.java:127)
            [junit] 	at org.apache.uima.impl.AnalysisEngineFactory_impl.produceResource(AnalysisEngineFactory_impl.java:94)
            [junit] 	at org.apache.uima.impl.CompositeResourceFactory_impl.produceResource(CompositeResourceFactory_impl.java:62)
            [junit] 	at org.apache.uima.UIMAFramework.produceResource(UIMAFramework.java:267)
            [junit] 	at org.apache.uima.UIMAFramework.produceAnalysisEngine(UIMAFramework.java:335)
            [junit] 	at org.apache.lucene.analysis.uima.ae.BasicAEProvider.getAE(BasicAEProvider.java:73)
            [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.<init>(BaseUIMATokenizer.java:45)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.<init>(UIMATypeAwareAnnotationsTokenizer.java:54)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzer.createComponents(UIMATypeAwareAnalyzer.java:40)
            [junit] 	at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:83)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:368)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:338)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:330)
            [junit] 
            [junit] "Thread-46" prio=10 tid=0x00007fbec10df000 nid=0x4977 runnable [0x00007fbebfb7e000]
            [junit]    java.lang.Thread.State: RUNNABLE
            [junit] 	at java.util.HashMap.getEntry(HashMap.java:347)
            [junit] 	at java.util.HashMap.containsKey(HashMap.java:335)
            [junit] 	at java.util.HashSet.contains(HashSet.java:184)
            [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineManagementImpl.setName(AnalysisEngineManagementImpl.java:242)
            [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.initialize(AnalysisEngineImplBase.java:181)
            [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.initialize(AggregateAnalysisEngine_impl.java:127)
            [junit] 	at org.apache.uima.impl.AnalysisEngineFactory_impl.produceResource(AnalysisEngineFactory_impl.java:94)
            [junit] 	at org.apache.uima.impl.CompositeResourceFactory_impl.produceResource(CompositeResourceFactory_impl.java:62)
            [junit] 	at org.apache.uima.UIMAFramework.produceResource(UIMAFramework.java:267)
            [junit] 	at org.apache.uima.UIMAFramework.produceAnalysisEngine(UIMAFramework.java:335)
            [junit] 	at org.apache.lucene.analysis.uima.ae.BasicAEProvider.getAE(BasicAEProvider.java:73)
            [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.<init>(BaseUIMATokenizer.java:45)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.<init>(UIMATypeAwareAnnotationsTokenizer.java:54)
            [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzer.createComponents(UIMATypeAwareAnalyzer.java:40)
            [junit] 	at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:83)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:368)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:338)
            [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:330)
        
        Show
        Robert Muir added a comment - If you try this seed a lot of times, eventually it will reproduce. I tried adding -Dtests.iter=10 to my command-line, so 'ant test -Dtestcase=UIMATypeAwareAnalyzerTest -Dtests.seed=-262aada3325aa87a:-44863926cf5c87e9:5c8c471d901b98bd -Dtests.iter=10' after about 3 or 4 runs it hung... though interestingly it hung at 200% cpu usage (as if two of the analysis threads were stuck). Stacktrace is in the same place, just for both threads: [junit] "Thread-48" prio=10 tid=0x00007fbec0b9c000 nid=0x4979 runnable [0x00007fbebfa7d000] [junit] java.lang.Thread.State: RUNNABLE [junit] at java.util.HashMap.getEntry(HashMap.java:347) [junit] at java.util.HashMap.containsKey(HashMap.java:335) [junit] at java.util.HashSet.contains(HashSet.java:184) [junit] at org.apache.uima.analysis_engine.impl.AnalysisEngineManagementImpl.setName(AnalysisEngineManagementImpl.java:242) [junit] at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.initialize(AnalysisEngineImplBase.java:181) [junit] at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.initialize(AggregateAnalysisEngine_impl.java:127) [junit] at org.apache.uima.impl.AnalysisEngineFactory_impl.produceResource(AnalysisEngineFactory_impl.java:94) [junit] at org.apache.uima.impl.CompositeResourceFactory_impl.produceResource(CompositeResourceFactory_impl.java:62) [junit] at org.apache.uima.UIMAFramework.produceResource(UIMAFramework.java:267) [junit] at org.apache.uima.UIMAFramework.produceAnalysisEngine(UIMAFramework.java:335) [junit] at org.apache.lucene.analysis.uima.ae.BasicAEProvider.getAE(BasicAEProvider.java:73) [junit] at org.apache.lucene.analysis.uima.BaseUIMATokenizer.<init>(BaseUIMATokenizer.java:45) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.<init>(UIMATypeAwareAnnotationsTokenizer.java:54) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzer.createComponents(UIMATypeAwareAnalyzer.java:40) [junit] at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:83) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:368) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:338) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:330) [junit] [junit] "Thread-46" prio=10 tid=0x00007fbec10df000 nid=0x4977 runnable [0x00007fbebfb7e000] [junit] java.lang.Thread.State: RUNNABLE [junit] at java.util.HashMap.getEntry(HashMap.java:347) [junit] at java.util.HashMap.containsKey(HashMap.java:335) [junit] at java.util.HashSet.contains(HashSet.java:184) [junit] at org.apache.uima.analysis_engine.impl.AnalysisEngineManagementImpl.setName(AnalysisEngineManagementImpl.java:242) [junit] at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.initialize(AnalysisEngineImplBase.java:181) [junit] at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.initialize(AggregateAnalysisEngine_impl.java:127) [junit] at org.apache.uima.impl.AnalysisEngineFactory_impl.produceResource(AnalysisEngineFactory_impl.java:94) [junit] at org.apache.uima.impl.CompositeResourceFactory_impl.produceResource(CompositeResourceFactory_impl.java:62) [junit] at org.apache.uima.UIMAFramework.produceResource(UIMAFramework.java:267) [junit] at org.apache.uima.UIMAFramework.produceAnalysisEngine(UIMAFramework.java:335) [junit] at org.apache.lucene.analysis.uima.ae.BasicAEProvider.getAE(BasicAEProvider.java:73) [junit] at org.apache.lucene.analysis.uima.BaseUIMATokenizer.<init>(BaseUIMATokenizer.java:45) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.<init>(UIMATypeAwareAnnotationsTokenizer.java:54) [junit] at org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzer.createComponents(UIMATypeAwareAnalyzer.java:40) [junit] at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:83) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:368) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:338) [junit] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:330)
        Hide
        Tommaso Teofili added a comment -

        I tried to reproduce that many times (same command/seed) but with no luck so far, which environment are you running Robert?

        Show
        Tommaso Teofili added a comment - I tried to reproduce that many times (same command/seed) but with no luck so far, which environment are you running Robert?
        Hide
        Robert Muir added a comment -

        linux amd64. I can try to dig into this, and ill try upgrading my jvm etc too, its a bit outdated

        Show
        Robert Muir added a comment - linux amd64. I can try to dig into this, and ill try upgrading my jvm etc too, its a bit outdated
        Hide
        Robert Muir added a comment -

        I think i got lucky yesterday twice... its pretty hard to reproduce this now. Maybe a thread-safety issue?

        I'll look more. My computer has been known to be crazy... dont waste time on this one Tommaso, I'll try to dig in more.

        Show
        Robert Muir added a comment - I think i got lucky yesterday twice... its pretty hard to reproduce this now. Maybe a thread-safety issue? I'll look more. My computer has been known to be crazy... dont waste time on this one Tommaso, I'll try to dig in more.
        Hide
        Tommaso Teofili added a comment -

        Ok thanks Robert, let me know if you find a specific scenario where this happens more frequently so that I can try it out as well.

        Show
        Tommaso Teofili added a comment - Ok thanks Robert, let me know if you find a specific scenario where this happens more frequently so that I can try it out as well.
        Hide
        Robert Muir added a comment -

        Tommaso my computer has been crazy before... I'll keep the issue open for a while and if someone else
        encounters this running tests, then we can take it more seriously. Otherwise after some time I will
        just cancel it as "not a problem".

        Show
        Robert Muir added a comment - Tommaso my computer has been crazy before... I'll keep the issue open for a while and if someone else encounters this running tests, then we can take it more seriously. Otherwise after some time I will just cancel it as "not a problem".

          People

          • Assignee:
            Unassigned
            Reporter:
            Robert Muir
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:

              Development