[HADOOP-16079] Token.toString faulting if any token listed can't load.

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.1.2, 3.2.1
• Fix Version/s: 3.2.1, 3.1.3
• Component/s: security
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 28/Jan/19 17:05
• Updated: 01/Feb/19 14:50
• Resolved: 01/Feb/19 14:35

Description

The patch in HADOOP-15808 turns out not to be enough; Token.toString() fails if any token in the service lists isn't known.

If any JAR lists a class in META-INF/services/org.apache.hadoop.security.token.TokenIdentifier which refers to a class which for any reason cannot load (e.g. it depends on a class which is in a JAR that is not on the classpath), then the enumeration of all tokens and their supported kinds will fail. This can surface in Token.toString(), but it will also break the RM token renewal thread.

Issue Links

• relates to: HADOOP-14556 S3A to support Delegation Tokens
• supercedes: HADOOP-15808 Harden Token service loader use