Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14422

FTPFileSystem and distcp does not work when ecnountered a complex ftp password with char ':' or '@'

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 3.0.0-alpha2
    • Fix Version/s: None
    • Component/s: fs, tools/distcp
    • Labels:
      None

      Description

      ftp username: test passwd:1@123
      hadoop distcp ftp://test:1@123@node2/home/test/ hdfs://piaopiao/test

      17/05/15 15:24:56 INFO tools.DistCp: Input Options: DistCpOptions

      {atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[ftp://test:1@123@node2/home/test], targetPath=/test, targetPathExists=true, preserveRawXattrs=false, filtersFile='null'}

      17/05/15 15:24:57 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
      17/05/15 15:24:59 ERROR tools.DistCp: Exception encountered
      java.io.IOException: Login failed on server - 0.0.0.0, port - 21 as user 'null'
      at org.apache.hadoop.fs.ftp.FTPFileSystem.connect(FTPFileSystem.java:154)
      at org.apache.hadoop.fs.ftp.FTPFileSystem.getFileStatus(FTPFileSystem.java:415)
      at org.apache.hadoop.fs.Globber.getFileStatus(Globber.java:68)
      at org.apache.hadoop.fs.Globber.glob(Globber.java:263)
      at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1630)
      at org.apache.hadoop.tools.GlobbedCopyListing.doBuildListing(GlobbedCopyListing.java:77)
      at org.apache.hadoop.tools.CopyListing.buildListing(CopyListing.java:86)
      at org.apache.hadoop.tools.DistCp.createInputFileListing(DistCp.java:389)
      at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:187)
      at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)
      at org.apache.hadoop.tools.DistCp.run(DistCp.java:126)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.hadoop.tools.DistCp.main(DistCp.java:453)

        Attachments

        1. HADOOP-14422.patch
          5 kB
          Hongyuan Li
        2. HADOOP-14422-002.patch
          5 kB
          Hongyuan Li
        3. HADOOP-14422-003.patch
          8 kB
          Hongyuan Li
        4. HADOOP-14422-004.patch
          8 kB
          Hongyuan Li
        5. HADOOP-14422-005.patch
          9 kB
          Hongyuan Li

          Activity

            People

            • Assignee:
              Hongyuan Li Hongyuan Li
              Reporter:
              Hongyuan Li Hongyuan Li
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: