[HADOOP-13099] Glob should return files with special characters in name

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.6.0
• Fix Version/s: 3.0.0-alpha1
• Component/s: fs
• Assignee: John Zhuge
• Reporter: John Zhuge
• Created: 05/May/16 08:48
• Updated: 16/May/16 14:43
• Resolved: 05/May/16 21:18

Description

In a directory, create a file with a name containing non-printable character, e.g., '\r'. dfs -ls dir can list such file, but dfs -ls dir/* can not.

$ hdfs dfs -touchz /tmp/test/abc
$ hdfs dfs -touchz $'/tmp/test/abc\rdef'
$ hdfs dfs -ls /tmp/test
Found 2 items
-rw-r--r--   3 systest supergroup          0 2016-05-05 01:35 /tmp/test/abc
def-r--r--   3 systest supergroup          0 2016-05-05 01:36 /tmp/test/abc
$ hdfs dfs -ls /tmp/test | od -c
0000000   F   o   u   n   d       2       i   t   e   m   s  \n   -   r
0000020   w   -   r   -   -   r   -   -               3       s   y   s
0000040   t   e   s   t       s   u   p   e   r   g   r   o   u   p    
0000060                                       0       2   0   1   6   -
0000100   0   5   -   0   5       0   1   :   3   5       /   t   m   p
0000120   /   t   e   s   t   /   a   b   c  \n   -   r   w   -   r   -
0000140   -   r   -   -               3       s   y   s   t   e   s   t
0000160       s   u   p   e   r   g   r   o   u   p                    
0000200                       0       2   0   1   6   -   0   5   -   0
0000220   5       0   1   :   3   6       /   t   m   p   /   t   e   s
0000240   t   /   a   b   c  \r   d   e   f  \n
0000252
$ hdfs dfs -ls /tmp/test/*
-rw-r--r--   3 systest supergroup          0 2016-05-05 01:35 /tmp/test/abc

Issue Links

• duplicates: HADOOP-12436 GlobPattern regex library has performance issues with wildcard characters
• duplicates: HADOOP-13051 Add Glob unit test for special characters
• relates to: HADOOP-7222 Inconsistent behavior when passing a path with special characters as literals to some FsShell commands