[AMBARI-20538] zeppelin spark/spark2 failing due to failure to initialize spark context

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.5.0
• Fix Version/s: 2.5.1
• Component/s: ambari-server
• Assignee: Prabhjyot Singh
• Reporter: Prabhjyot Singh
• Created: 23/Mar/17 06:23
• Updated: 04/Apr/17 08:06
• Resolved: 04/Apr/17 07:19

Description

Spark context creation fails due to following exception :

ERROR [2017-03-20 20:39:26,068] ({pool-2-thread-4} HiveMetaStoreClient.java[close]:495) - Unable to shutdown local metastore client
org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (Write failed)
        at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161)
        at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
        at com.facebook.fb303.FacebookService$Client.send_shutdown(FacebookService.java:436)
        at com.facebook.fb303.FacebookService$Client.shutdown(FacebookService.java:430)
        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:492)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156)
        at com.sun.proxy.$Proxy20.close(Unknown Source)
        at org.apache.hadoop.hive.ql.metadata.Hive.close(Hive.java:291)
        at org.apache.hadoop.hive.ql.metadata.Hive.access$000(Hive.java:137)
        at org.apache.hadoop.hive.ql.metadata.Hive$1.remove(Hive.java:157)
        at org.apache.hadoop.hive.ql.metadata.Hive.closeCurrent(Hive.java:261)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
    

The reason for this is "hive-site.xml" is not present in "<zeppelin-conf-directory>/hive-site.xml"

Issue Links

• links to: review link