[OOZIE-2531] Prevent Spark trying for token which is already available

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.3.0
• Assignee: Satish Saley
• Reporter: Satish Saley
• Created: 13/May/16 21:27
• Updated: 02/Dec/16 21:03
• Resolved: 19/May/16 06:38

Description

As per Apache Spark documentation :
The property spark.yarn.security.tokens.service.enabled in Apache Spark which controls whether to retrieve delegation tokens for non-HDFS services when security is enabled. By default, delegation tokens for all supported services are retrieved when those services are configured, but it's possible to disable that behavior if it somehow conflicts with the application being run.
Currently supported services are: hive, hbase

It would be good to have default as spark.yarn.security.tokens.hive.enabled=false to avoid having Spark redundantly retry obtaining a token when it already has one (passed originally from Oozie's hcat credentials).