[HDFS-3905] Secure cluster cannot use hftp to an insecure cluster

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.23.3
• Fix Version/s: 0.23.5
• Component/s: hdfs-client, security
• Target Version/s: 0.23.3
• Assignee: Daryn Sharp
• Reporter: Daryn Sharp
• Created: 07/Sep/12 21:22
• Updated: 29/Jul/14 23:02
• Resolved: 03/Oct/12 19:19

Description

HDFS-3873 fixed the case where all exceptions acquiring tokens for hftp were ignored. Jobs would be submitted sans tokens, and then the tasks would eventually all fail trying to get the missing token. HDFS-3873 made jobs fail to submit if the remote cluster is secure.

Unfortunately it regressed the ability for a secure cluster to access an insecure cluster over hftp. The issue is unique to 23 due to KSSL.

Issue Links

• duplicates: HADOOP-6525 Support secure clients connecting to insecure servers
• is broken by: HDFS-3873 Hftp assumes security is disabled if token fetch fails
• relates to: HADOOP-8828 Support distcp from secure to insecure clusters