[ZEPPELIN-3851] Flaky test - LivyInterpreterIT

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Lee Moon Soo
• Created: 05/Nov/18 18:38
• Updated: 05/Nov/18 18:38

Description

Flaky test on

• LivyInterpreterIT.testPySparkInterpreter
• LivyInterpreterIT.testSparkInterpreterWithDisplayAppInfo_StringWithoutTruncation
• LivyInterpreterIT.testSparkInterpreter

18/11/05 02:59:45 INFO Client: Application report for application_1541386527524_0006 (state: ACCEPTED)
18/11/05 02:59:45 INFO Client: 
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1541386785198
	 final status: UNDEFINED
	 tracking URL: http://travis-job-ebd07cc4-099c-4b69-be82-33e56b246eba:40966/proxy/application_1541386527524_0006/
	 user: travis
18/11/05 02:59:45 INFO ShutdownHookManager: Shutdown hook called
18/11/05 02:59:45 INFO ShutdownHookManager: Deleting directory /tmp/spark-261368a3-9d39-4f78-92fa-88ff256924c9

YARN Diagnostics: 
Application killed by user.
	at org.apache.zeppelin.livy.BaseLivyInterpreter.createSession(BaseLivyInterpreter.java:332)
	at org.apache.zeppelin.livy.BaseLivyInterpreter.initLivySession(BaseLivyInterpreter.java:186)
	at org.apache.zeppelin.livy.BaseLivyInterpreter.open(BaseLivyInterpreter.java:163)
	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkInterpreter(LivyInterpreterIT.java:108)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
 INFO [2018-11-05 03:01:10,292] ({main} LivyInterpreterIT.java[tearDown]:71) - Shutting down livy at http://travis-job-ebd07cc4-099c-4b69-be82-33e56b246eba:8998
Tests run: 6, Failures: 1, Errors: 2, Skipped: 0, Time elapsed: 366.203 sec <<< FAILURE! - in org.apache.zeppelin.livy.LivyInterpreterIT
testPySparkInterpreter(org.apache.zeppelin.livy.LivyInterpreterIT)  Time elapsed: 25.45 sec  <<< FAILURE!
java.lang.AssertionError: expected:<SUCCESS> but was:<ERROR>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:834)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:144)
	at org.apache.zeppelin.livy.LivyInterpreterIT.testPySparkInterpreter(LivyInterpreterIT.java:397)

testSparkInterpreterWithDisplayAppInfo_StringWithoutTruncation(org.apache.zeppelin.livy.LivyInterpreterIT)  Time elapsed: 90.882 sec  <<< ERROR!
org.apache.zeppelin.interpreter.InterpreterException: Fail to create session, please check livy interpreter log and livy server log
	at org.apache.zeppelin.livy.BaseLivyInterpreter.createSession(BaseLivyInterpreter.java:332)
	at org.apache.zeppelin.livy.BaseLivyInterpreter.initLivySession(BaseLivyInterpreter.java:186)
	at org.apache.zeppelin.livy.BaseLivyInterpreter.open(BaseLivyInterpreter.java:163)
	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkInterpreterWithDisplayAppInfo_StringWithoutTruncation(LivyInterpreterIT.java:509)

testSparkInterpreter(org.apache.zeppelin.livy.LivyInterpreterIT)  Time elapsed: 90.6 sec  <<< ERROR!
org.apache.zeppelin.interpreter.InterpreterException: Fail to create session, please check livy interpreter log and livy server log
	at org.apache.zeppelin.livy.BaseLivyInterpreter.createSession(BaseLivyInterpreter.java:332)
	at org.apache.zeppelin.livy.BaseLivyInterpreter.initLivySession(BaseLivyInterpreter.java:186)
	at org.apache.zeppelin.livy.BaseLivyInterpreter.open(BaseLivyInterpreter.java:163)
	at org.apache.zeppelin.livy.LivyInterpreterIT.testSparkInterpreter(LivyInterpreterIT.java:108)

 INFO [2018-11-05 03:01:24,911] ({Thread-0} Logging.scala[info]:39) - Shutting down cluster pool.

Results :

Failed tests: 
  LivyInterpreterIT.testPySparkInterpreter:397 expected:<SUCCESS> but was:<ERROR>

Tests in error: 
  LivyInterpreterIT.testSparkInterpreterWithDisplayAppInfo_StringWithoutTruncation:509 » Interpreter
  LivyInterpreterIT.testSparkInterpreter:108 » Interpreter Fail to create sessio...

Tests run: 6, Failures: 1, Errors: 2, Skipped: 0