[HADOOP-14422] FTPFileSystem and distcp does not work when ecnountered a complex ftp password with char ':' or '@'

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0-alpha2
• Component/s: fs, tools/distcp
• Assignee: Hongyuan Li
• Reporter: Hongyuan Li
• Created: 15/May/17 07:50
• Updated: 04/Jul/17 11:55
• Resolved: 04/Jul/17 11:55

Description

ftp username: test passwd:1@123
hadoop distcp ftp://test:1@123@node2/home/test/ hdfs://piaopiao/test

17/05/15 15:24:56 INFO tools.DistCp: Input Options: DistCpOptions

{atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[ftp://test:1@123@node2/home/test], targetPath=/test, targetPathExists=true, preserveRawXattrs=false, filtersFile='null'}

17/05/15 15:24:57 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
17/05/15 15:24:59 ERROR tools.DistCp: Exception encountered
java.io.IOException: Login failed on server - 0.0.0.0, port - 21 as user 'null'
at org.apache.hadoop.fs.ftp.FTPFileSystem.connect(FTPFileSystem.java:154)
at org.apache.hadoop.fs.ftp.FTPFileSystem.getFileStatus(FTPFileSystem.java:415)
at org.apache.hadoop.fs.Globber.getFileStatus(Globber.java:68)
at org.apache.hadoop.fs.Globber.glob(Globber.java:263)
at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1630)
at org.apache.hadoop.tools.GlobbedCopyListing.doBuildListing(GlobbedCopyListing.java:77)
at org.apache.hadoop.tools.CopyListing.buildListing(CopyListing.java:86)
at org.apache.hadoop.tools.DistCp.createInputFileListing(DistCp.java:389)
at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:187)
at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:126)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.tools.DistCp.main(DistCp.java:453)