[HDFS-4951] FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0-beta
• Fix Version/s: 2.1.0-beta
• Component/s: security
• Target Version/s: 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Robert Kanter
• Reporter: Robert Kanter
• Created: 02/Jul/13 23:18
• Updated: 27/Aug/13 22:08
• Resolved: 09/Jul/13 18:49

Description

It looks like there isn't a TokenRenewer for HttpFS delegation tokens (HTTPFS_DELEGATION_TOKENS tokens, so when it goes to cancel the token, it throws an exception:

$ hadoop fs -ls webhdfs://host:14000
// File listing omitted
13/06/21 13:09:04 WARN token.Token: No TokenRenewer defined for token kind HTTPFS_DELEGATION_TOKEN
13/06/21 13:09:04 WARN util.ShutdownHookManager: ShutdownHook 'ClientFinalizer' failed, java.lang.UnsupportedOperationException: Token cancel is not supported  for HTTPFS_DELEGATION_TOKEN tokens
java.lang.UnsupportedOperationException: Token cancel is not supported  for HTTPFS_DELEGATION_TOKEN tokens
	at org.apache.hadoop.security.token.Token$TrivialRenewer.cancel(Token.java:417)
	at org.apache.hadoop.security.token.Token.cancel(Token.java:382)
	at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.cancel(DelegationTokenRenewer.java:146)
	at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.access$200(DelegationTokenRenewer.java:58)
	at org.apache.hadoop.fs.DelegationTokenRenewer.removeRenewAction(DelegationTokenRenewer.java:233)
	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.close(WebHdfsFileSystem.java:790)
	at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2398)
	at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2414)
	at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)

WebHDFS doesn't have this problem because it has a TokenRenewer for its delegation tokens ("WEBHDFS delegation" tokens).