[HDFS-6143] WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.5.0
• Hadoop Flags: Reviewed
• Assignee: Gera Shegalov
• Reporter: Gera Shegalov
• Created: 23/Mar/14 07:18
• Updated: 30/Jun/15 07:25
• Resolved: 08/Apr/14 01:45

Description

WebHdfsFileSystem.open and HftpFileSystem.open incorrectly handles non-existing paths.

• 'open', does not really open anything, i.e., it does not contact the server, and therefore cannot discover FileNotFound, it's deferred until next read. It's counterintuitive and not how local FS or HDFS work. In POSIX you get ENOENT on open. LzoInputFormat.getSplits is an example of the code that's broken because of this.

• On the server side, FileDataServlet incorrectly sends SC_BAD_REQUEST instead of SC_NOT_FOUND for non-exitsing paths

Issue Links

• breaks: HDFS-7049 TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2
• is related to: HDFS-6199 WebHdfsFileSystem does not treat UnresolvedLinkException
• is required by: HDFS-6193 HftpFileSystem open should throw FileNotFoundException for non-existing paths