[HDFS-10474] hftp copy fails when file name with Chinese+special char in branch-2

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.8.0, 2.7.3
• Target Version/s: 2.7.3
• Hadoop Flags: Reviewed
• Assignee: Brahma Reddy Battula
• Reporter: Brahma Reddy Battula
• Created: 01/Jun/16 07:12
• Updated: 01/Dec/16 23:18
• Resolved: 20/Jun/16 07:23

Description

I have seen this , while using distcp

16/05/23 20:35:34 INFO mapreduce.Job: Task Id : attempt_1463564396851_0010_m_000003_0, Status : FAILED
Error: java.io.IOException: File copy failed: hftp://*****:25000/tmp/???@2X.png --> hdfs://hacluster/cxf7/tmp/节节高@2X.png
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:285)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:180)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1672)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:174)
Caused by: java.io.IOException: Couldn't run retriable-command: Copying hftp://*******:25000/tmp/节节高@2X.png to hdfs://hacluster/cxf7/tmp/节节高@2X.png
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
	... 10 more