[HDFS-12052] Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3, 3.0.0-alpha3
• Fix Version/s: 3.0.0-beta1, 2.10.0
• Component/s: httpfs, webhdfs
• Target Version/s: 3.0.0-beta1
• Assignee: Zoran Dimitrijevic
• Reporter: Zoran Dimitrijevic
• Created: 28/Jun/17 00:24
• Updated: 09/Nov/17 17:48
• Resolved: 11/Jul/17 18:27

Description

When httpfs runs with httpfs.ssl.enabled it should return SWEBHDFS delegation tokens.

Currently, httpfs returns WEBHDFS delegation "kind" for tokens regardless of whether ssl is enabled or not. If clients directly connect to renew tokens (for example, hdfs dfs) all works because httpfs doesn't check whether token kind is for swebhdfs or webhdfs. However, this breaks when yarn rm needs to renew the token for the job (for example, when running hadoop distcp). Since DT kind is WEBHDFS, rm tries to establish non-ssl connection to httpfs and fails.

I've tested a simple patch which I'll upload to this jira, and it fixes this issue (hadoop distcp works).