[HADOOP-11750] distcp fails if we copy data from swift to secure HDFS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.3.0, 3.0.0-alpha1
• Component/s: fs/swift
• Assignee: Chen He
• Reporter: Chen He
• Created: 26/Mar/15 00:24
• Updated: 12/May/16 18:21
• Resolved: 26/Mar/15 10:18

Description

ERROR tools.DistCp: Exception encountered
java.lang.IllegalArgumentException: java.net.UnknownHostException: babynames.main
at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:373)
at org.apache.hadoop.security.SecurityUtil.buildDTServiceName(SecurityUtil.java:258)
at org.apache.hadoop.fs.FileSystem.getCanonicalServiceName(FileSystem.java:301)
at org.apache.hadoop.fs.FileSystem.collectDelegationTokens(FileSystem.java:523)
at org.apache.hadoop.fs.FileSystem.addDelegationTokens(FileSystem.java:507)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
at org.apache.hadoop.tools.SimpleCopyListing.validatePaths(SimpleCopyListing.java:133)
at org.apache.hadoop.tools.CopyListing.buildListing(CopyListing.java:83)
at org.apache.hadoop.tools.GlobbedCopyListing.doBuildListing(GlobbedCopyListing.java:90)
at org.apache.hadoop.tools.CopyListing.buildListing(CopyListing.java:84)
at org.apache.hadoop.tools.DistCp.createInputFileListing(DistCp.java:353)
at org.apache.hadoop.tools.DistCp.execute(DistCp.java:160)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:121)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.tools.DistCp.main(DistCp.java:401)
Caused by: java.net.UnknownHostException: babynames.main
... 17 more

Issue Links

• is related to: HADOOP-11762 Enable swift distcp to secure HDFS