[SPARK-12241] Improve failure reporting in Yarn client obtainTokenForHBase()

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.5.2
• Fix Version/s: 2.0.0
• Component/s: Spark Core, YARN

Environment

Kerberos

• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 09/Dec/15 14:29
• Updated: 17/May/20 18:17
• Resolved: 09/Dec/15 18:26

Description

SPARK-11265 improved reporting of reflection problems getting the Hive token in a secure cluster.

The `obtainTokenForHBase()` method needs to pick up the same policy of what exceptions to swallow/reject, and report any swallowed exceptions with the full stack trace.

without this, problems authenticating with HBase result in log errors with no meaningful information at all.

Issue Links

• is duplicated by: SPARK-11317 YARN HBase token code shouldn't swallow invocation target exceptions
• is related to: HADOOP-12563 Updated utility to create/modify token files
• relates to: SPARK-11265 YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster
• links to: [Github] Pull Request #10227 (steveloughran)