[ZEPPELIN-5475] K8S service host not found

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Not A Bug
• Affects Version/s: 0.9.0
• Component/s: Kubernetes
• Labels: Kubernetes spark
• Assignee: Thomas Decaux
• Reporter: Thomas Decaux
• Created: 31/Jul/21 20:05
• Updated: 03/Jun/22 08:48
• Resolved: 03/Jun/22 08:48

Description

K8S services hostname are "SERVICE.NAMESPACE.svc.cluster.local", according doc at https://kubernetes.io/docs/concepts/services-networking/service/.

And spec at https://github.com/kubernetes/dns/blob/master/docs/specification.md 

When using Zep + Spark on kubernetes, this cause:
 

ERROR [2021-07-31 19:43:59,041] ({RegisterThread} RemoteInterpreterServer.java[run]:613) - Error while registering interpreter: RegisterInfo(host:10.233.82.20, port:12321, interpreterGroupId:spark-2GBUTPS15), cause: {} java.lang.RuntimeException: java.io.IOException: org.apache.zeppelin.shaded.org.apache.thrift.transport.TTransportException: java.net.UnknownHostException: zeppelin-server.dev-steam.svc at org.apache.zeppelin.interpreter.remote.PooledRemoteClient.callRemoteFunction(PooledRemoteClient.java:100) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventClient.callRemoteFunction(RemoteInterpreterEventClient.java:81) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventClient.registerInterpreterProcess(RemoteInterpreterEventClient.java:89) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$RegisterRunnable.run(RemoteInterpreterServer.java:610) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: org.apache.zeppelin.shaded.org.apache.thrift.transport.TTransportException: java.net.UnknownHostException: zeppelin-server.dev-steam.svc at org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventClient.lambda$new$0(RemoteInterpreterEventClient.java:73) at org.apache.zeppelin.interpreter.remote.RemoteClientFactory.create(RemoteClientFactory.java:54) at org.apache.zeppelin.interpreter.remote.RemoteClientFactory.create(RemoteClientFactory.java:34) at org.apache.zeppelin.shaded.org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60) at org.apache.zeppelin.shaded.org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861) at org.apache.zeppelin.shaded.org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)