[HIVE-15767] Hive On Spark is not working on secure clusters from Oozie

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.1, 2.1.1
• Fix Version/s: 3.0.0
• Component/s: Spark
• Assignee: Gézapeti
• Reporter: Gézapeti
• Created: 31/Jan/17 12:21
• Updated: 22/May/18 23:58
• Resolved: 11/Aug/17 16:52

Description

When a HiveAction is launched form Oozie with Hive On Spark enabled, we're getting errors:

Caused by: java.io.IOException: Exception reading file:/yarn/nm/usercache/yshi/appcache/application_1485271416004_0022/container_1485271416004_0022_01_000002/container_tokens
        at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:188)
        at org.apache.hadoop.mapreduce.security.TokenCache.mergeBinaryTokens(TokenCache.java:155)

This is caused by passing the mapreduce.job.credentials.binary property to the Spark configuration in RemoteHiveSparkClient.