Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1806

CI build fails on LivyInterpreterIT.testSparkSQLInterpreter

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: livy-interpreter
    • Labels:

      Description

      I faced an livy integration test failure in https://github.com/apache/zeppelin/pull/1689. This PR is irrelevant with the livy interpreter

      ERROR [2016-12-14 02:15:32,165] ({main} LivyHelper.java[createSession]:117) - Cannot start  spark.
      
      ERROR [2016-12-14 02:15:32,166] ({main} LivyHelper.java[createSession]:129) - Error getting session for user
      java.lang.Exception: Cannot start  spark.
      
      	at org.apache.zeppelin.livy.LivyHelper.createSession(LivyHelper.java:118)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.createSession(BaseLivyInterprereter.java:68)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.interpret(BaseLivyInterprereter.java:91)
      	at org.apache.zeppelin.livy.LivySparkSQLInterpreter.interpret(LivySparkSQLInterpreter.java:71)
      	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkSQLInterpreter(LivyInterpreterIT.java:226)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
      	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
      ERROR [2016-12-14 02:15:32,168] ({main} BaseLivyInterprereter.java[interpret]:93) - Exception while creating livy session
      java.lang.Exception: Cannot start  spark.
      
      	at org.apache.zeppelin.livy.LivyHelper.createSession(LivyHelper.java:118)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.createSession(BaseLivyInterprereter.java:68)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.interpret(BaseLivyInterprereter.java:91)
      	at org.apache.zeppelin.livy.LivySparkSQLInterpreter.interpret(LivySparkSQLInterpreter.java:71)
      	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkSQLInterpreter(LivyInterpreterIT.java:226)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
      	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
      DEBUG [2016-12-14 02:15:32,168] ({main} LivyHelper.java[executeHTTP]:346) - Call rest api in http://testing-docker-0806bccc-910a-4a5d-a16a-a8a41519ebef:8998/sessions, method: POST, jsonData: {"kind": "spark", "conf": {}, "proxyUser": "user1"}
      ERROR [2016-12-14 02:15:32,195] ({main} LivyHelper.java[createSession]:98) - sessionId:4.0 state is starting
      DEBUG [2016-12-14 02:15:33,195] ({main} LivyHelper.java[executeHTTP]:346) - Call rest api in http://testing-docker-0806bccc-910a-4a5d-a16a-a8a41519ebef:8998/sessions/4, method: GET, jsonData: null
      ERROR [2016-12-14 02:15:33,209] ({main} LivyHelper.java[createSession]:98) - sessionId:4.0 state is starting
      DEBUG [2016-12-14 02:15:34,210] ({main} LivyHelper.java[executeHTTP]:346) - Call rest api in http://testing-docker-0806bccc-910a-4a5d-a16a-a8a41519ebef:8998/sessions/4, method: GET, jsonData: null
      ERROR [2016-12-14 02:15:34,224] ({main} LivyHelper.java[createSession]:98) - sessionId:4.0 state is starting
      DEBUG [2016-12-14 02:15:35,224] ({main} LivyHelper.java[executeHTTP]:346) - Call rest api in http://testing-docker-0806bccc-910a-4a5d-a16a-a8a41519ebef:8998/sessions/4, method: GET, jsonData: null
      DEBUG [2016-12-14 02:15:35,238] ({main} LivyHelper.java[executeHTTP]:346) - Call rest api in http://testing-docker-0806bccc-910a-4a5d-a16a-a8a41519ebef:8998/sessions/4/log, method: GET, jsonData: null
      ERROR [2016-12-14 02:15:35,250] ({main} LivyHelper.java[createSession]:117) - Cannot start  spark.
      
      ERROR [2016-12-14 02:15:35,250] ({main} LivyHelper.java[createSession]:129) - Error getting session for user
      java.lang.Exception: Cannot start  spark.
      
      	at org.apache.zeppelin.livy.LivyHelper.createSession(LivyHelper.java:118)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.createSession(BaseLivyInterprereter.java:68)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.interpret(BaseLivyInterprereter.java:91)
      	at org.apache.zeppelin.livy.LivySparkSQLInterpreter.interpret(LivySparkSQLInterpreter.java:73)
      	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkSQLInterpreter(LivyInterpreterIT.java:226)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
      	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
      ERROR [2016-12-14 02:15:35,251] ({main} BaseLivyInterprereter.java[interpret]:93) - Exception while creating livy session
      java.lang.Exception: Cannot start  spark.
      
      	at org.apache.zeppelin.livy.LivyHelper.createSession(LivyHelper.java:118)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.createSession(BaseLivyInterprereter.java:68)
      	at org.apache.zeppelin.livy.BaseLivyInterprereter.interpret(BaseLivyInterprereter.java:91)
      	at org.apache.zeppelin.livy.LivySparkSQLInterpreter.interpret(LivySparkSQLInterpreter.java:73)
      	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkSQLInterpreter(LivyInterpreterIT.java:226)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
      	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
      	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
      	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
      	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
      Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 146.328 sec <<< FAILURE! - in org.apache.zeppelin.livy.LivyInterpreterIT
      testSparkSQLInterpreter(org.apache.zeppelin.livy.LivyInterpreterIT)  Time elapsed: 7.298 sec  <<< FAILURE!
      java.lang.AssertionError: expected:<SUCCESS> but was:<ERROR>
      	at org.junit.Assert.fail(Assert.java:88)
      	at org.junit.Assert.failNotEquals(Assert.java:834)
      	at org.junit.Assert.assertEquals(Assert.java:118)
      	at org.junit.Assert.assertEquals(Assert.java:144)
      	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkSQLInterpreter(LivyInterpreterIT.java:227)
      
       INFO [2016-12-14 02:15:50,112] ({Thread-0} Logging.scala[info]:40) - Shutting down cluster pool.
      
      Results :
      
      Failed tests: 
        LivyInterpreterIT.testSparkSQLInterpreter:227 expected:<SUCCESS> but was:<ERROR>
      
      Tests run: 5, Failures: 1, Errors: 0, Skipped: 0
      
      [INFO] 
      [INFO] --- maven-failsafe-plugin:2.16:verify (default) @ zeppelin-livy ---
      [INFO] Failsafe report directory: /home/travis/build/apache/zeppelin/livy/target/failsafe-reports
      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO] 
      [INFO] Zeppelin: Interpreter .............................. SUCCESS [02:02 min]
      [INFO] Zeppelin: Livy interpreter ......................... FAILURE [02:34 min]
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 04:37 min
      [INFO] Finished at: 2016-12-14T02:15:50+00:00
      [INFO] Final Memory: 55M/1301M
      [INFO] ------------------------------------------------------------------------
      [WARNING] The requested profile "spark-1.5" could not be activated because it does not exist.
      [WARNING] The requested profile "hadoop-2.6" could not be activated because it does not exist.
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.16:verify (default) on project zeppelin-livy: There are test failures.
      [ERROR] 
      [ERROR] Please refer to /home/travis/build/apache/zeppelin/livy/target/failsafe-reports for the individual test results.
      [ERROR] -> [Help 1]
      [ERROR] 
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR] 
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
      [ERROR] 
      [ERROR] After correcting the problems, you can resume the build with the command
      [ERROR]   mvn <goals> -rf :zeppelin-livy
      

        Attachments

          Activity

            People

            • Assignee:
              zjffdu Jeff Zhang
              Reporter:
              1ambda Hoon Park
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: