Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6143

WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.5.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      WebHdfsFileSystem.open and HftpFileSystem.open incorrectly handles non-existing paths.

      • 'open', does not really open anything, i.e., it does not contact the server, and therefore cannot discover FileNotFound, it's deferred until next read. It's counterintuitive and not how local FS or HDFS work. In POSIX you get ENOENT on open. LzoInputFormat.getSplits is an example of the code that's broken because of this.
      • On the server side, FileDataServlet incorrectly sends SC_BAD_REQUEST instead of SC_NOT_FOUND for non-exitsing paths

        Attachments

        1. HDFS-6143.v01.patch
          8 kB
          Gera Shegalov
        2. HDFS-6143.v02.patch
          12 kB
          Gera Shegalov
        3. HDFS-6143.v03.patch
          20 kB
          Gera Shegalov
        4. HDFS-6143.v04.patch
          20 kB
          Gera Shegalov
        5. HDFS-6143.v04.patch
          20 kB
          Gera Shegalov
        6. HDFS-6143.v05.patch
          8 kB
          Gera Shegalov
        7. HDFS-6143.v06.patch
          6 kB
          Gera Shegalov
        8. HDFS-6143-branch-2.4.0.v01.patch
          6 kB
          Gera Shegalov
        9. HDFS-6143-trunk-after-HDFS-5570.v01.patch
          5 kB
          Gera Shegalov
        10. HDFS-6143-trunk-after-HDFS-5570.v02.patch
          3 kB
          Gera Shegalov

          Issue Links

            Activity

              People

              • Assignee:
                jira.shegalov Gera Shegalov
                Reporter:
                jira.shegalov Gera Shegalov
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: