[ZEPPELIN-1546] Zeppelin Livy Interpreter 404 Exception not caught with Kerberos

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 0.6.0, 0.6.1, 0.6.2, 0.7.0
• Component/s: livy-interpreter

Environment

Kerberized Zeppelin, Livy and Hadoop Cluster

• Flags: Patch
• Assignee: Jeff Zhang
• Reporter: Greg Senia
• Created: 13/Oct/16 16:22
• Updated: 17/May/17 18:37
• Resolved: 07/Mar/17 03:54

Description

Livy Interpreter gets a NestedRuntimException when running with Kerberized components.
INFO [2016-10-13 22:24:37,576] (

{pool-2-thread-4} SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1476411877576 started by scheduler org.apache.zeppelin.livy.LivySparkInterpreter103042912
ERROR [2016-10-13 22:24:37,935] ({pool-2-thread-4}

LivyHelper.java[interpretInput]:190) - Interpreter exception
org.springframework.web.client.RestClientException: Error running rest call; nested exception is org.springframework.web.client.HttpClientErrorException: 404 Not Found
at org.springframework.security.kerberos.client.KerberosRestTemplate.doExecute(KerberosRestTemplate.java:196)
at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:580)
at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:498)
at org.apache.zeppelin.livy.LivyHelper.executeHTTP(LivyHelper.java:356)
at org.apache.zeppelin.livy.LivyHelper.executeCommand(LivyHelper.java:297)
at org.apache.zeppelin.livy.LivyHelper.interpret(LivyHelper.java:238)
at org.apache.zeppelin.livy.LivyHelper.interpretInput(LivyHelper.java:188)
at org.apache.zeppelin.livy.LivySparkInterpreter.interpret(LivySparkInterpreter.java:108)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:390)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.springframework.web.client.HttpClientErrorException: 404 Not Found
at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:91)
at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:667)
at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:620)
at org.springframework.security.kerberos.client.KerberosRestTemplate.doExecuteSubject(KerberosRestTemplate.java:202)
at org.springframework.security.kerberos.client.KerberosRestTemplate.access$100(KerberosRestTemplate.java:67)
at org.springframework.security.kerberos.client.KerberosRestTemplate$1.run(KerberosRestTemplate.java:191)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.springframework.security.kerberos.client.KerberosRestTemplate.doExecute(KerberosRestTemplate.java:187)
... 18 more
INFO [2016-10-13 22:24:37,937] (

{pool-2-thread-4}

SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1476411877576 finished by scheduler org.apache.zeppelin.livy.LivySparkInterpreter103042912

Issue Links

• Dependent: ZEPPELIN-1516 NPE LivySparkSQLInterpreter thrown with %livy.sql interpreter function
• is duplicated by: ZEPPELIN-2116 livy interpreter needs to restart after previous session timeout in secured cluster
• links to: GitHub Pull Request #1503
• links to: GitHub Pull Request #1512
• links to: GitHub Pull Request #1516