Uploaded image for project: 'Apache Knox'
  1. Apache Knox
  2. KNOX-754

curl requests fail when dealing with special characters

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.9.1
    • 0.10.0
    • ClientDSL, Server
    • None
    • Apache Knox 0.9.1, Apache Hadoop 2.7.2

    Description

      Since Knox 0.9.1, Knox can't work with files which contain special characters as : é, ù, ü, è, etc... This is reproducible at 100%. It was working well with Knox 0.7.0 so it's a regression.

      This happens when doing a GET or a PUT of a file of this type, and more particularly at the "location" process of the request. You can find an example below:

      [shfs3453@spark01 Pig]$ curl -Iikv -u shfs3453 -X GET 'https://knox-gateway.fr/gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN'
      Enter host password for user 'shfs3453':
      * About to connect() to knox-gateway port 443 (#0)
      *   Trying 10.117.41.12... connected
      * Connected to knox-gateway (10.117.41.12) port 443 (#0)
      * Initializing NSS with certpath: sql:/etc/pki/nssdb
      * warning: ignoring value of ssl.verifyhost
      * skipping SSL peer certificate verification
      * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA
      * Server certificate:
      *       subject: E=********@*****,CN=knox-gateway,OU=*****,O=****,L=*****,ST=*****,C=***
      *       start date: Nov 07 11:33:05 2014 GMT
      *       expire date: Nov 06 11:33:05 2019 GMT
      *       common name: knox-gateway
      *       issuer: CN=***************,OU=*******,OU=********,O=******,C=***
      * Server auth using Basic with user 'shfs3453'
      > GET /gateway/bigdata/webhdfs/v1/user/shfs3453/WORK/datasets/test_électronique_embarqué.pdf?OP=OPEN HTTP/1.1
      > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh
      > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
      > Host: knox-gateway
      > Accept: */*
      >
      < HTTP/1.1 307 Temporary Redirect
      HTTP/1.1 307 Temporary Redirect
      < Date: Wed, 05 Oct 2016 07:19:55 GMT
      Date: Wed, 05 Oct 2016 07:19:55 GMT
      < Set-Cookie: JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly
      Set-Cookie: JSESSIONID=4zv7v1911q5vvcg6r1tqxe77;Path=/gateway/bigdata;Secure;HttpOnly
      < Expires: Thu, 01 Jan 1970 00:00:00 GMT
      Expires: Thu, 01 Jan 1970 00:00:00 GMT
      < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; Expires=Tue, 04-Oct-2016 07:19:56 GMT
      Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; Expires=Tue, 04-Oct-2016 07:19:56 GMT
      < Cache-Control: no-cache
      Cache-Control: no-cache
      < Expires: Wed, 05 Oct 2016 07:19:56 GMT
      Expires: Wed, 05 Oct 2016 07:19:56 GMT
      < Date: Wed, 05 Oct 2016 07:19:56 GMT
      Date: Wed, 05 Oct 2016 07:19:56 GMT
      < Pragma: no-cache
      Pragma: no-cache
      < Expires: Wed, 05 Oct 2016 07:19:56 GMT
      Expires: Wed, 05 Oct 2016 07:19:56 GMT
      < Date: Wed, 05 Oct 2016 07:19:56 GMT
      Date: Wed, 05 Oct 2016 07:19:56 GMT
      < Pragma: no-cache
      Pragma: no-cache
      < Location: https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=AAAACAAAABAAAAEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg
      Location: https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=AAAACAAAABAAAAEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld2WWGEPyWRubcgb4e6xO2F4jo96NSZhuAP8iarY5LiCtTydLPBXcEbbD146jLD7S83Mhij4VS5sO1asESNH5y8_5Z2PvLcZE11WiTS9alu-9AUqXNixw1t9Y5Em6xDle7s8-oiF3nPVM80RIdbJel4LoeCZuB2zgddLaJAYx5tSb03-QGNzupOPQ5UQ0_7ybPwmAsgiFfFNuvMbj9sKgxLg
      < Content-Type: application/octet-stream
      Content-Type: application/octet-stream
      < Server: Jetty(6.1.26)
      Server: Jetty(6.1.26)
      < Content-Length: 0
      Content-Length: 0
      
      <
      * Connection #0 to host knox-gateway left intact
      * Issue another request to this URL: 'https://knox-gateway/gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=AAAACAAAABAAAAEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld54aYH365vWu3V6u-_BaX3E1Ax5puYXZkEypdB2SOKVFW5bqIi5JFkgUr_XV8bXdcFTcdbohr82pKVBqmK-OvSZnCAVSdy4Yjyf51fSLo_n07ElHK84zqsXEMLU1zF5DHbSKC_jwpGahsm5VlYK7H5Ppwt0SNFHIx50O9yBpPLHYNe-ALlqTOlq6UT3ifFufhmKsY6chP6IxLw7ZyCHrBSA'
      * Re-using existing connection! (#0) with host knox-gateway
      * Connected to knox-gateway (10.117.41.12) port 443 (#0)
      * Server auth using Basic with user 'shfs3453'
      > GET /gateway/bigdata/webhdfs/data/v1/webhdfs/v1/user/shfs3453/WORK/datasets/test_▒lectronique_embarqu▒.pdf?_=AAAACAAAABAAAAEAl_jkRL_c3Tzm7hoXMR1KPge4OClEqM4hfs3eslFzfdY5CBbrfaMzOa--NXb08Xjw2O11CkOtyUX5kXwh2IgZmxjw_TNHqQUvVAfFkeXiMDiBXxpbhulsVx3o_NLn9pCLsp09xJ9r1utCHrueYOAvuxY_ksQWuHld54aYH365vWu3V6u-_BaX3E1Ax5puYXZkEypdB2SOKVFW5bqIi5JFkgUr_XV8bXdcFTcdbohr82pKVBqmK-OvSZnCAVSdy4Yjyf51fSLo_n07ElHK84zqsXEMLU1zF5DHbSKC_jwpGahsm5VlYK7H5Ppwt0SNFHIx50O9yBpPLHYNe-ALlqTOlq6UT3ifFufhmKsY6chP6IxLw7ZyCHrBSA HTTP/1.1
      > Authorization: Basic c2hmczM0NTM6UGIxOTkxMTAh
      > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
      > Host: knox-gateway
      > Accept: */*
      >
      < HTTP/1.1 404 Not Found
      HTTP/1.1 404 Not Found
      < Date: Wed, 05 Oct 2016 07:32:07 GMT
      Date: Wed, 05 Oct 2016 07:32:07 GMT
      < Set-Cookie: JSESSIONID=1kp671ikau2cieuzdlw84yeh;Path=/gateway/bigdata;Secure;HttpOnly
      Set-Cookie: JSESSIONID=1kp671ikau2cieuzdlw84yeh;Path=/gateway/bigdata;Secure;HttpOnly
      < Expires: Thu, 01 Jan 1970 00:00:00 GMT
      Expires: Thu, 01 Jan 1970 00:00:00 GMT
      < Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; Expires=Tue, 04-Oct-2016 07:32:07 GMT
      Set-Cookie: rememberMe=deleteMe; Path=/gateway/bigdata; Max-Age=0; Expires=Tue, 04-Oct-2016 07:32:07 GMT
      < Content-Type: application/json; charset=utf-8
      Content-Type: application/json; charset=utf-8
      < Connection: close
      Connection: close
      < Server: Jetty(9.2.15.v20160210)
      Server: Jetty(9.2.15.v20160210)
      
      <
      * Closing connection #0
      

      Attachments

        1. KNOX_754.patch
          0.9 kB
          Sumit Gupta

        Activity

          People

            sumit.gupta Sumit Gupta
            BigDataOrange Alexandre Linte
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: