Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12220

TestReplicationHandle.doTestStressReplication() fails on Windows because an index directory can't be deleted

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Several recent Jenkins failures, e.g. https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/533/:

         [junit4]   2> 1820871 ERROR (qtp574829981-16047) [    x:collection1] o.a.s.c.CachingDirectoryFactory Error removing directory C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandler_A86A8FEB7F34064-001\solr-instance-028\collection1\data\index.20180408092515440 before 
      core close:java.io.IOException: Unable to delete file: C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandler_A86A8FEB7F34064-001\solr-instance-028\collection1\data\index.20180408092515440\_0_Lucene50_0.tim
         [junit4]   2>        at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2381)
         [junit4]   2>        at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1679)
         [junit4]   2>        at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1575)
         [junit4]   2>        at org.apache.solr.core.StandardDirectoryFactory.removeDirectory(StandardDirectoryFactory.java:108)
         [junit4]   2>        at org.apache.solr.core.CachingDirectoryFactory.closeCacheValue(CachingDirectoryFactory.java:274)
         [junit4]   2>        at org.apache.solr.core.CachingDirectoryFactory.release(CachingDirectoryFactory.java:437)
         [junit4]   2>        at org.apache.solr.search.SolrIndexSearcher.close(SolrIndexSearcher.java:496)
         [junit4]   2>        at org.apache.solr.core.SolrCore$2.close(SolrCore.java:2402)
         [junit4]   2>        at org.apache.solr.util.RefCounted.decref(RefCounted.java:56)
         [junit4]   2>        at org.apache.solr.request.SolrQueryRequestBase.close(SolrQueryRequestBase.java:154)
         [junit4]   2>        at org.apache.solr.servlet.HttpSolrCall.destroy(HttpSolrCall.java:566)
         [junit4]   2>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:411)
         [junit4]   2>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:339)
         [junit4]   2>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
         [junit4]   2>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
         [junit4]   2>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
         [junit4]   2>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
         [junit4]   2>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
         [junit4]   2>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
         [junit4]   2>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
         [junit4]   2>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
         [junit4]   2>        at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
         [junit4]   2>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
         [junit4]   2>        at org.eclipse.jetty.server.Server.handle(Server.java:530)
         [junit4]   2>        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
         [junit4]   2>        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
         [junit4]   2>        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
         [junit4]   2>        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
         [junit4]   2>        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
         [junit4]   2>        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
         [junit4]   2>        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
         [junit4]   2>        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
         [junit4]   2>        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
         [junit4]   2>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
         [junit4]   2>        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
         [junit4]   2>        at java.base/java.lang.Thread.run(Thread.java:844)
      [...]
         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandler -Dtests.method=doTestStressReplication -Dtests.seed=A86A8FEB7F34064 -Dtests.slow=true -Dtests.locale=kab-DZ -Dtests.timezone=Asia/Jayapura -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
         [junit4]   2> 1820933 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    ] o.a.s.c.DirectoryFactory Deleted old index directory: C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandler_A86A8FEB7F34064-001\solr-instance-028\.\collection1\data\index.20180408092515440
         [junit4] FAILURE 1.06s J0 | TestReplicationHandler.doTestStressReplication <<<
         [junit4]    > Throwable #1: java.lang.AssertionError: found:2[index.20180408092515440, index.20180408092515667, index.properties, replication.properties, snapshot_metadata]
         [junit4]    >        at __randomizedtesting.SeedInfo.seed([A86A8FEB7F34064:D12DA838B2DB29D7]:0)
         [junit4]    >        at org.apache.solr.handler.TestReplicationHandler.checkForSingleIndex(TestReplicationHandler.java:966)
         [junit4]    >        at org.apache.solr.handler.TestReplicationHandler.checkForSingleIndex(TestReplicationHandler.java:937)
         [junit4]    >        at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:913)
         [junit4]    >        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         [junit4]    >        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
         [junit4]    >        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
         [junit4]    >        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
         [junit4]    >        at java.base/java.lang.Thread.run(Thread.java:844)
      

      I'll attach the full log for this ^^ failure.

      Other recent failures with this pattern: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/532/, https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/535/, https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/536/, https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/538/, https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/541/, https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/7255/, https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/7256/,
      https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/7259/, https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/7263/,
      https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/7266/, https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/7267/

      Attachments

        Activity

          People

            Unassigned Unassigned
            sarowe Steven Rowe
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: