[HDFS-14762] "Path(Path/String parent, String child)" will fail when "child" contains ":"

• Type: Bug
• Status: Reopened
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Shixiong Zhu
• Created: 21/Aug/19 22:09
• Updated: 18/May/20 13:33

Description

When the "child" parameter contains ":", "Path(Path/String parent, String child)" will throw the following exception:

java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ...

Not sure if this is a legit bug. But the following places will hit this error when seeing a Path with a file name containing ":":

https://github.com/apache/hadoop/blob/f9029c4070e8eb046b403f5cb6d0a132c5d58448/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ChecksumFileSystem.java#L101
https://github.com/apache/hadoop/blob/f9029c4070e8eb046b403f5cb6d0a132c5d58448/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/Globber.java#L270

Issue Links

• causes: SPARK-28841 Spark cannot read a relative path containing ":"
• relates to: HADOOP-11890 Uber-JIRA: Hadoop should support IPv6