[CONNECTORS-1708] MongoDB Connector - Integration tests broken - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: ManifoldCF 2.22
Component/s: MongoDB Output Connector
Labels:
None

Description

Trying to execute integration tests with both Ant and Maven, it returns the following error. We are probably using old dependencies of mongodb and de.flapdoodle.embed. Updating both of these dependencies should solve the problem.

    [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz

run-IT-HSQLDB:
    [junit] Testsuite: org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT
    [junit] Configuration file successfully read
    [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized @941ms to org.eclipse.jetty.util.log.Slf4jLog
    [junit] [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.25.v20191220; built: 2019-12-20T17:00:00.294Z; git: a9729c7e7f33a459d2616a8f9e9ba8a90f432e95; jvm 11.0.13+8-LTS
    [junit] [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
    [junit] [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
    [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 660000ms
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-2356674270627149959.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-11820210731741565141.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-6023197707410686222.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346}
    [junit] [main] INFO org.eclipse.jetty.server.Server - Started @1817ms
    [junit] Download Version{2.6.8}:OS_X:B32 START
    [junit] [main] ERROR de.flapdoodle.embed.process.runtime.Starter - prepare executable
    [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:131)
    [junit] at de.flapdoodle.embed.process.store.Downloader.download(Downloader.java:69)
    [junit] at de.flapdoodle.embed.process.store.ArtifactStore.checkDistribution(ArtifactStore.java:66)
    [junit] at de.flapdoodle.embed.process.store.ExtractedArtifactStore.checkDistribution(ExtractedArtifactStore.java:60)
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:56)
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:49)
    [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:69)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    [junit] at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    [junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    [junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    [junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
    [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
    [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
    [junit] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
    [junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
    [junit] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    [junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    [junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
    [junit] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    [junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
    [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:535)
    [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1197)
    [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:1042)
    [junit] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
    [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
    [junit] at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250)
    [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:127)
    [junit] ... 28 more
    [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346}
    [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped scavenging
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war}
    [junit] Tests run: 1, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6,805 sec
    [junit]
    [junit] ------------- Standard Output ---------------
    [junit] Download Version{2.6.8}:OS_X:B32 START
    [junit] ------------- ---------------- ---------------
    [junit] ------------- Standard Error -----------------
    [junit] Configuration file successfully read
    [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized @941ms to org.eclipse.jetty.util.log.Slf4jLog
    [junit] [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.25.v20191220; built: 2019-12-20T17:00:00.294Z; git: a9729c7e7f33a459d2616a8f9e9ba8a90f432e95; jvm 11.0.13+8-LTS
    [junit] [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
    [junit] [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
    [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 660000ms
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-2356674270627149959.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-11820210731741565141.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,file:///private/var/folders/g1/vlf2szxj7tbbgm92n39l8kj80000gn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-6023197707410686222.dir/webapp/,AVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346}
    [junit] [main] INFO org.eclipse.jetty.server.Server - Started @1817ms
    [junit] [main] ERROR de.flapdoodle.embed.process.runtime.Starter - prepare executable
    [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:131)
    [junit] at de.flapdoodle.embed.process.store.Downloader.download(Downloader.java:69)
    [junit] at de.flapdoodle.embed.process.store.ArtifactStore.checkDistribution(ArtifactStore.java:66)
    [junit] at de.flapdoodle.embed.process.store.ExtractedArtifactStore.checkDistribution(ExtractedArtifactStore.java:60)
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:56)
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:49)
    [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:69)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    [junit] at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    [junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    [junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    [junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
    [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
    [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
    [junit] at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
    [junit] at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
    [junit] at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    [junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    [junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
    [junit] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    [junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
    [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:535)
    [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1197)
    [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:1042)
    [junit] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
    [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
    [junit] at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250)
    [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:127)
    [junit] ... 28 more
    [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@6dc1484{HTTP/1.1,[http/1.1]}{0.0.0.0:8346}
    [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped scavenging
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@34cf5a97{ManifoldCF General API Webapp,/mcf-api-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-api-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@3703bf3c{ManifoldCF Authorities API Webapp,/mcf-authority-service,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-authority-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.w.WebAppContext@4482469c{ManifoldCF Crawler Interface,/mcf-crawler-ui,null,UNAVAILABLE}{/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/web/war/mcf-crawler-ui.war}
    [junit] ------------- ---------------- ---------------
    [junit] Testcase: sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT): Caused an ERROR
    [junit] java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] de.flapdoodle.embed.process.exceptions.DistributionException: java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:69)
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:49)
    [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:69)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    [junit] Caused by: java.io.IOException: Could not open inputStream for https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:131)
    [junit] at de.flapdoodle.embed.process.store.Downloader.download(Downloader.java:69)
    [junit] at de.flapdoodle.embed.process.store.ArtifactStore.checkDistribution(ArtifactStore.java:66)
    [junit] at de.flapdoodle.embed.process.store.ExtractedArtifactStore.checkDistribution(ExtractedArtifactStore.java:60)
    [junit] at de.flapdoodle.embed.process.runtime.Starter.prepare(Starter.java:56)
    [junit] Caused by: java.io.IOException: Server returned HTTP response code: 403 for URL: https://fastdl.mongodb.org/osx/mongodb-osx-i386-2.6.8.tgz
    [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
    [junit] at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
    [junit] at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250)
    [junit] at de.flapdoodle.embed.process.store.Downloader.downloadInputStream(Downloader.java:127)
    [junit]
    [junit]
    [junit] Testcase: sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT): Caused an ERROR
    [junit] null
    [junit] java.lang.NullPointerException
    [junit] at org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT.removeTestArea(APISanityHSQLDBIT.java:109)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    [junit] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    [junit]
    [junit]

BUILD FAILED
/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/build.xml:516: The following error occurred while executing this line:
/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/build.xml:470: The following error occurred while executing this line:
/Users/pjlucidi/Downloads/apache-manifoldcf-2.22/dist/connector-build.xml:1102: Test org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT failed

Attachments

Activity

People

Assignee:: Piergiorgio Lucidi

Reporter:: Piergiorgio Lucidi

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 27/Apr/22 07:47

Updated:: 30/Apr/22 15:39

Resolved:: 27/Apr/22 12:50