[HDFS-10735] Distcp using webhdfs on secure HA clusters fails with StandbyException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.2
• Fix Version/s: 2.8.0, 3.0.0-alpha2
• Component/s: webhdfs
• Hadoop Flags: Reviewed
• Assignee: Benoy Antony
• Reporter: Benoy Antony
• Created: 09/Aug/16 00:51
• Updated: 18/Oct/16 22:02
• Resolved: 14/Oct/16 17:40

Description

A distcp running on HADOOP 2.7.2 cluster , copying from HADOOP 2.4.1 cluster fails.
Both are secure clusters.
The logs indicates that task contacts the StandBy name node on the remote cluster i first and gets a standByException.
Instead of retrying with the active name node on the remote cluster, the execution errors out throwing InvalidToken

The exception is attached