Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14408

HttpFS handles paths with special charactes different than WebHdfs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 3.1.1
    • Fix Version/s: None
    • Component/s: httpfs
    • Labels:
      None

      Description

      After HDFS-13176 WebHdfsFileSystem encodes special characters twice. For example path /tmp/day=2018-01-01 becomes /webhdfs/v1/tmp/day%253D2018-01-01 call.

      In NamenodeWebHdfsMethods it is handled by decode path twice (first by web server and then in code explicityly).

      But if we use httpfs it fails to get paths with special characters (like `=`), cause it decodes path once.

      Test to reproduce and simple fix in attachment. Although I think that double encoding doesn't look right.

        Attachments

        1. httpfs-special-test.patch
          2 kB
          Andrey Zinovyev
        2. httpfs-special-fix.patch
          1 kB
          Andrey Zinovyev

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                zvez Andrey Zinovyev
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: