Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10474

hftp copy fails when file name with Chinese+special char in branch-2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.8.0, 2.7.3
    • None
    • None
    • Reviewed

    Description

      I have seen this , while using distcp

      16/05/23 20:35:34 INFO mapreduce.Job: Task Id : attempt_1463564396851_0010_m_000003_0, Status : FAILED
      Error: java.io.IOException: File copy failed: hftp://*****:25000/tmp/???@2X.png --> hdfs://hacluster/cxf7/tmp/节节高@2X.png
      	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:285)
      	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
      	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
      	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
      	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:180)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:422)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1672)
      	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:174)
      Caused by: java.io.IOException: Couldn't run retriable-command: Copying hftp://*******:25000/tmp/节节高@2X.png to hdfs://hacluster/cxf7/tmp/节节高@2X.png
      	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
      	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
      	... 10 more
      

      Attachments

        1. HDFS-10474-branch-2.7-001.patch
          4 kB
          Brahma Reddy Battula
        2. HDFS-10474-branch-2-001.patch
          5 kB
          Brahma Reddy Battula
        3. HDFS-10474-branch-2-002.patch
          5 kB
          Brahma Reddy Battula

        Activity

          People

            brahmareddy Brahma Reddy Battula
            brahmareddy Brahma Reddy Battula
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: