[HDFS-13] filenames with ':' colon throws java.lang.IllegalArgumentException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Lohit Vijaya Renu
• Created: 16/Oct/07 21:52
• Updated: 24/Mar/17 19:56
• Resolved: 02/Jan/12 03:40

Description

File names containing colon ":" throws java.lang.IllegalArgumentException while LINUX file system supports it.

$ hadoop dfs -put ./testfile-2007-09-24-03:00:00.gz filenametest
Exception in thread "main" java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute
URI: testfile-2007-09-24-03:00:00.gz
at org.apache.hadoop.fs.Path.initialize(Path.java:140)
at org.apache.hadoop.fs.Path.<init>(Path.java:126)
at org.apache.hadoop.fs.Path.<init>(Path.java:50)
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:273)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:117)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:776)
at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:757)
at org.apache.hadoop.fs.FsShell.copyFromLocal(FsShell.java:116)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1229)
at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:187)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1342)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: testfile-2007-09-24-03:00:00.gz
at java.net.URI.checkPath(URI.java:1787)
at java.net.URI.<init>(URI.java:735)
at org.apache.hadoop.fs.Path.initialize(Path.java:137)
... 10 more

Path(String pathString) when given a filename which contains ':' treats it as URI and selects anything before ':' as
scheme, which in this case is clearly not a valid scheme.

Issue Links

• is duplicated by: HDFS-2557 Naming convention for files being moved into HDFS
• is part of: HADOOP-3257 Path should handle all characters
• is related to: HADOOP-3256 JobHistory file on HDFS should not use the 'job name'
• is related to: HADOOP-3173 inconsistent globbing support for dfs commands
• is related to: HADOOP-6334 GenericOptionsParser does not understand uri for -files -libjars and -archives option
• relates to: HADOOP-14217 Object Storage: support colon in object path
• relates to: HADOOP-3733 "s3:" URLs break when Secret Key contains a slash, even if encoded