Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10474

hftp copy fails when file name with Chinese+special char in branch-2

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.3
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      I have seen this , while using distcp

      16/05/23 20:35:34 INFO mapreduce.Job: Task Id : attempt_1463564396851_0010_m_000003_0, Status : FAILED
      Error: java.io.IOException: File copy failed: hftp://*****:25000/tmp/???@2X.png --> hdfs://hacluster/cxf7/tmp/节节高@2X.png
      	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:285)
      	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
      	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
      	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
      	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:180)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:422)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1672)
      	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:174)
      Caused by: java.io.IOException: Couldn't run retriable-command: Copying hftp://*******:25000/tmp/节节高@2X.png to hdfs://hacluster/cxf7/tmp/节节高@2X.png
      	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
      	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
      	... 10 more
      

        Attachments

        1. HDFS-10474-branch-2.7-001.patch
          4 kB
          Brahma Reddy Battula
        2. HDFS-10474-branch-2-001.patch
          5 kB
          Brahma Reddy Battula
        3. HDFS-10474-branch-2-002.patch
          5 kB
          Brahma Reddy Battula

          Activity

            People

            • Assignee:
              brahmareddy Brahma Reddy Battula
              Reporter:
              brahmareddy Brahma Reddy Battula
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: