Uploaded image for project: 'HttpComponents HttpClient'
  1. HttpComponents HttpClient
  2. HTTPCLIENT-1993

wget returns 200/OK while org.apache.http.impl.client.CloseableHttpClient returns 404/NOT_FOUND

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Invalid
    • 4.5.9
    • None
    • HttpClient (classic)
    • linux java 1.8

    Description

      (first posted on SO: https://stackoverflow.com/questions/56598349/ where I was suggested it could be a bug in the library. I've updated my library with 4.5.9: same result)

       

      I'm trying to read this URL (  "https://www.encodeproject.org/files/ENCFF784GFP/@@download/ENCFF784GFP.hic" ) using http-components/java.

      It works fine with wget:

      
    wget -S -q -O - "https://www.encodeproject.org/files/ENCFF784GFP/@@download/ENCFF784GFP.hic" > /dev/null 
    (...)
      HTTP/1.1 200 OK
      x-amz-id-2: 5vWTJmx5PF0uyuR8cUWwtx9zOei2ewX+yskiLlqKMFJOzkBKP/ND3pTKdC2/9+WYjqTIGuQ/Cp4=
      x-amz-request-id: B447183CF808894B
      Date: Fri, 14 Jun 2019 12:29:39 GMT
      Last-Modified: Sat, 09 Feb 2019 09:14:26 GMT
      ETag: "ccaabdcb885389d618bfe826e67fe680-521"
      Content-Disposition: attachment; filename=ENCFF784GFP.hic
      Accept-Ranges: bytes
      Content-Type: binary/octet-stream
      Content-Length: 4367743691
      Server: AmazonS3
    (...)

      while I get a 404 with the following java code:

          (...)
            final HttpClientBuilder hb = HttpClients.custom();
            final CloseableHttpClient httpClient = hb.build();
            
            final HttpHead httpHead = new HttpHead(url.toExternalForm());
            
            
                final CloseableHttpResponse response = httpClient.execute(httpHead);
                if (response.getStatusLine().getStatusCode() != HttpStatus.SC_OK ) {
                    
                    final String msg = "Unexpected Http status code "
                             + response.getStatusLine()+" for \""+ url+"\""
                             ;
                    response.close();
                    httpClient.close();
                     throw new IOException(msg);
                        }
    (...)

      with the following log:

       

       

      2019/06/14 16:41:34:681 CEST [DEBUG] RequestAddCookies - CookieSpec selected: default
2019/06/14 16:41:34:695 CEST [DEBUG] RequestAuthCache - Auth cache not set in the context
2019/06/14 16:41:34:698 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection request: [route: {s}->https://www.encodeproject.org:443][total kept alive: 0; route allocated: 0 of 2; total allocated: 0 of 20]
2019/06/14 16:41:34:714 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection leased: [id: 0][route: {s}->https://www.encodeproject.org:443][total kept alive: 0; route allocated: 1 of 2; total allocated: 1 of 20]
2019/06/14 16:41:34:715 CEST [DEBUG] MainClientExec - Opening connection {s}->https://www.encodeproject.org:443
2019/06/14 16:41:34:852 CEST [DEBUG] DefaultHttpClientConnectionOperator - Connecting to www.encodeproject.org/34.211.244.144:443
2019/06/14 16:41:34:852 CEST [DEBUG] SSLConnectionSocketFactory - Connecting socket to www.encodeproject.org/34.211.244.144:443 with timeout 0
2019/06/14 16:41:35:092 CEST [DEBUG] SSLConnectionSocketFactory - Enabled protocols: [TLSv1, TLSv1.1, TLSv1.2]
2019/06/14 16:41:35:093 CEST [DEBUG] SSLConnectionSocketFactory - Enabled cipher suites:[TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA384, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
2019/06/14 16:41:35:093 CEST [DEBUG] SSLConnectionSocketFactory - Starting handshake
2019/06/14 16:41:35:487 CEST [DEBUG] SSLConnectionSocketFactory - Secure session established
2019/06/14 16:41:35:488 CEST [DEBUG] SSLConnectionSocketFactory -  negotiated protocol: TLSv1.2
2019/06/14 16:41:35:488 CEST [DEBUG] SSLConnectionSocketFactory -  negotiated cipher suite: TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
2019/06/14 16:41:35:488 CEST [DEBUG] SSLConnectionSocketFactory -  peer principal: CN=*.encodeproject.org, OU=Domain Control Validated
2019/06/14 16:41:35:489 CEST [DEBUG] SSLConnectionSocketFactory -  peer alternative names: [*.encodeproject.org, encodeproject.org]
2019/06/14 16:41:35:489 CEST [DEBUG] SSLConnectionSocketFactory -  issuer principal: CN=AlphaSSL CA - SHA256 - G2, O=GlobalSign nv-sa, C=BE
2019/06/14 16:41:35:494 CEST [DEBUG] DefaultHttpClientConnectionOperator - Connection established 172.18.240.255:34040<->34.211.244.144:443
2019/06/14 16:41:35:494 CEST [DEBUG] MainClientExec - Executing request HEAD /files/ENCFF784GFP/@@download/ENCFF784GFP.hic HTTP/1.1
2019/06/14 16:41:35:494 CEST [DEBUG] MainClientExec - Target auth state: UNCHALLENGED
2019/06/14 16:41:35:495 CEST [DEBUG] MainClientExec - Proxy auth state: UNCHALLENGED
2019/06/14 16:41:35:497 CEST [DEBUG] headers - http-outgoing-0 >> HEAD /files/ENCFF784GFP/@@download/ENCFF784GFP.hic HTTP/1.1
2019/06/14 16:41:35:497 CEST [DEBUG] headers - http-outgoing-0 >> Host: www.encodeproject.org
2019/06/14 16:41:35:497 CEST [DEBUG] headers - http-outgoing-0 >> Connection: Keep-Alive
2019/06/14 16:41:35:497 CEST [DEBUG] headers - http-outgoing-0 >> User-Agent: Apache-HttpClient/4.5.9 (Java/1.8.0_191)
2019/06/14 16:41:35:497 CEST [DEBUG] headers - http-outgoing-0 >> Accept-Encoding: gzip,deflate
2019/06/14 16:41:35:667 CEST [DEBUG] headers - http-outgoing-0 << HTTP/1.1 307 Temporary Redirect
2019/06/14 16:41:35:667 CEST [DEBUG] headers - http-outgoing-0 << Server: nginx/1.14.1
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << Date: Fri, 14 Jun 2019 14:26:44 GMT
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << Content-Type: text/plain; charset=UTF-8
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << Content-Length: 1581
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << Connection: keep-alive
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << X-Request-URL: https://www.encodeproject.org/files/ENCFF784GFP/@@download/ENCFF784GFP.hic
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << X-Stats: es_count=1&es_time=1972&queue_begin=1560522404679541&queue_time=434&rss_begin=488206336&rss_change=0&rss_end=488206336&wsgi_begin=1560522404679975&wsgi_end=1560522404688517&wsgi_time=8542
2019/06/14 16:41:35:668 CEST [DEBUG] headers - http-outgoing-0 << Access-Control-Allow-Origin: *
2019/06/14 16:41:35:669 CEST [DEBUG] headers - http-outgoing-0 << Access-Control-Allow-Methods: GET, HEAD
2019/06/14 16:41:35:669 CEST [DEBUG] headers - http-outgoing-0 << Access-Control-Allow-Headers: Accept, Origin, Range, X-Requested-With
2019/06/14 16:41:35:669 CEST [DEBUG] headers - http-outgoing-0 << Access-Control-Expose-Headers: Content-Length, Content-Range, Content-Type
2019/06/14 16:41:35:669 CEST [DEBUG] headers - http-outgoing-0 << Location: https://download.encodeproject.org/https://encode-public.s3.amazonaws.com/2018/04/06/8723ee96-ccee-4384-b5a8-4040262283eb/ENCFF784GFP.hic?response-content-disposition=attachment%3B%20filename%3DENCFF784GFP.hic&AWSAccessKeyId=ASIATGZNGCNXXPJTPGFC&Signature=62geOTSamvi215asIZXzrTUDmkM%3D&Expires=1560652004&x-amz-security-token=AgoJb3JpZ2luX2VjEMb%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLXdlc3QtMiJHMEUCIDHIut1ySUl%2FZPI%2BB0Qbza4jT9SEXsEVkXEzc0uVQPx%2BAiEA%2FX8zEiJiQOWBbngRnBwL3Ha2nbI2r68cIc5GmQCbO7Mq4wMI7%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAAGgwyMjA3NDg3MTQ4NjMiDLmNazt7Uno3MzIF%2Biq3A9s3QhvDZZr5IlE84sTDkrv4xp2eSRBE8fiCTxDP1dVaYX4%2FvaJJmLDqN%2FJnf6lWyA58Uhku2unejkvT3ZTrt7xG5EuTBPcVF3NDU6ZACsHInRNtZHguvnqYUj2jGoM5CIo2wh5lWHEmtqzGfkIhkkk3%2BR65kWOU9Cu0GdBYpNzanewfyyV3YrjNhVLavnyve0%2FKPAWb0QEM1X1Epm0ayyYJpf1ZDLxrLdrUS%2FDCP25nkIoBBHafIJIkzWlgUJO%2B5PmRDsHDGtK%2F6yJHI9SVO3uUe8qlTlMMrSyhap8d16063sFHObfkUTmOpFJlaLjeOdk0P9IhJPSifcv%2FGRG1N1TtponOtS6uRpfTF%2B5oUn7bGx6lknMfMOHFi0v6DPY%2FxHDuUoTorvW%2FA%2B4kJEK3vBBc1FIbrGXKkb8EUUkgCJgtin8c6dsgUcoIHAMreiJ6v7XPLOoXGy6rlFCMbVKmJ%2BrIsBMBbkKdqk1MCOpT93uFmhyiiwKnTJJosd2Ib2JcW1quL7Eb5P6OO%2FemGhn1ti3bIY%2BBBZZCaqI8PWpd3QgPTdWA74vVWznihvdDgOT1CB9%2FszZPIpswttOO6AU6tAFB7R3%2B78X%2FUvRzE%2BVxZuQxAKsRna3iATiVce6crDbmxP2MU7J4nw32mAa19lY1uKBr7%2Bn%2BkXPuW5ezKhf7msCoNCk1%2BoFSVAQ3mCI8rua%2B5maGlKvT9vya2SXKPu6YbnqqakDMeEgROtojzE%2BcwTpVoj86hKyamBt3576VEEfSw99c4k%2BTqJ%2B4kGshFC%2B2QARlCLMFldw%2FiSajSgHkwDHfhqdMk5j6mR%2B7fdccsylDaoksd8Q%3D
2019/06/14 16:41:35:669 CEST [DEBUG] headers - http-outgoing-0 << Strict-Transport-Security: max-age=15768000
2019/06/14 16:41:35:673 CEST [DEBUG] MainClientExec - Connection can be kept alive indefinitely
2019/06/14 16:41:35:673 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection [id: 0][route: {s}->https://www.encodeproject.org:443] can be kept alive indefinitely
2019/06/14 16:41:35:673 CEST [DEBUG] DefaultManagedHttpClientConnection - http-outgoing-0: set socket timeout to 0
2019/06/14 16:41:35:673 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection released: [id: 0][route: {s}->https://www.encodeproject.org:443][total kept alive: 1; route allocated: 1 of 2; total allocated: 1 of 20]
2019/06/14 16:41:35:676 CEST [DEBUG] DefaultRedirectStrategy - Redirect requested to location 'https://download.encodeproject.org/https://encode-public.s3.amazonaws.com/2018/04/06/8723ee96-ccee-4384-b5a8-4040262283eb/ENCFF784GFP.hic?response-content-disposition=attachment%3B%20filename%3DENCFF784GFP.hic&AWSAccessKeyId=ASIATGZNGCNXXPJTPGFC&Signature=62geOTSamvi215asIZXzrTUDmkM%3D&Expires=1560652004&x-amz-security-token=AgoJb3JpZ2luX2VjEMb%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLXdlc3QtMiJHMEUCIDHIut1ySUl%2FZPI%2BB0Qbza4jT9SEXsEVkXEzc0uVQPx%2BAiEA%2FX8zEiJiQOWBbngRnBwL3Ha2nbI2r68cIc5GmQCbO7Mq4wMI7%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAAGgwyMjA3NDg3MTQ4NjMiDLmNazt7Uno3MzIF%2Biq3A9s3QhvDZZr5IlE84sTDkrv4xp2eSRBE8fiCTxDP1dVaYX4%2FvaJJmLDqN%2FJnf6lWyA58Uhku2unejkvT3ZTrt7xG5EuTBPcVF3NDU6ZACsHInRNtZHguvnqYUj2jGoM5CIo2wh5lWHEmtqzGfkIhkkk3%2BR65kWOU9Cu0GdBYpNzanewfyyV3YrjNhVLavnyve0%2FKPAWb0QEM1X1Epm0ayyYJpf1ZDLxrLdrUS%2FDCP25nkIoBBHafIJIkzWlgUJO%2B5PmRDsHDGtK%2F6yJHI9SVO3uUe8qlTlMMrSyhap8d16063sFHObfkUTmOpFJlaLjeOdk0P9IhJPSifcv%2FGRG1N1TtponOtS6uRpfTF%2B5oUn7bGx6lknMfMOHFi0v6DPY%2FxHDuUoTorvW%2FA%2B4kJEK3vBBc1FIbrGXKkb8EUUkgCJgtin8c6dsgUcoIHAMreiJ6v7XPLOoXGy6rlFCMbVKmJ%2BrIsBMBbkKdqk1MCOpT93uFmhyiiwKnTJJosd2Ib2JcW1quL7Eb5P6OO%2FemGhn1ti3bIY%2BBBZZCaqI8PWpd3QgPTdWA74vVWznihvdDgOT1CB9%2FszZPIpswttOO6AU6tAFB7R3%2B78X%2FUvRzE%2BVxZuQxAKsRna3iATiVce6crDbmxP2MU7J4nw32mAa19lY1uKBr7%2Bn%2BkXPuW5ezKhf7msCoNCk1%2BoFSVAQ3mCI8rua%2B5maGlKvT9vya2SXKPu6YbnqqakDMeEgROtojzE%2BcwTpVoj86hKyamBt3576VEEfSw99c4k%2BTqJ%2B4kGshFC%2B2QARlCLMFldw%2FiSajSgHkwDHfhqdMk5j6mR%2B7fdccsylDaoksd8Q%3D'
2019/06/14 16:41:35:680 CEST [DEBUG] RedirectExec - Resetting target auth state
2019/06/14 16:41:35:680 CEST [DEBUG] RedirectExec - Redirecting to 'https://download.encodeproject.org/https://encode-public.s3.amazonaws.com/2018/04/06/8723ee96-ccee-4384-b5a8-4040262283eb/ENCFF784GFP.hic?response-content-disposition=attachment%3B%20filename%3DENCFF784GFP.hic&AWSAccessKeyId=ASIATGZNGCNXXPJTPGFC&Signature=62geOTSamvi215asIZXzrTUDmkM%3D&Expires=1560652004&x-amz-security-token=AgoJb3JpZ2luX2VjEMb%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLXdlc3QtMiJHMEUCIDHIut1ySUl%2FZPI%2BB0Qbza4jT9SEXsEVkXEzc0uVQPx%2BAiEA%2FX8zEiJiQOWBbngRnBwL3Ha2nbI2r68cIc5GmQCbO7Mq4wMI7%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAAGgwyMjA3NDg3MTQ4NjMiDLmNazt7Uno3MzIF%2Biq3A9s3QhvDZZr5IlE84sTDkrv4xp2eSRBE8fiCTxDP1dVaYX4%2FvaJJmLDqN%2FJnf6lWyA58Uhku2unejkvT3ZTrt7xG5EuTBPcVF3NDU6ZACsHInRNtZHguvnqYUj2jGoM5CIo2wh5lWHEmtqzGfkIhkkk3%2BR65kWOU9Cu0GdBYpNzanewfyyV3YrjNhVLavnyve0%2FKPAWb0QEM1X1Epm0ayyYJpf1ZDLxrLdrUS%2FDCP25nkIoBBHafIJIkzWlgUJO%2B5PmRDsHDGtK%2F6yJHI9SVO3uUe8qlTlMMrSyhap8d16063sFHObfkUTmOpFJlaLjeOdk0P9IhJPSifcv%2FGRG1N1TtponOtS6uRpfTF%2B5oUn7bGx6lknMfMOHFi0v6DPY%2FxHDuUoTorvW%2FA%2B4kJEK3vBBc1FIbrGXKkb8EUUkgCJgtin8c6dsgUcoIHAMreiJ6v7XPLOoXGy6rlFCMbVKmJ%2BrIsBMBbkKdqk1MCOpT93uFmhyiiwKnTJJosd2Ib2JcW1quL7Eb5P6OO%2FemGhn1ti3bIY%2BBBZZCaqI8PWpd3QgPTdWA74vVWznihvdDgOT1CB9%2FszZPIpswttOO6AU6tAFB7R3%2B78X%2FUvRzE%2BVxZuQxAKsRna3iATiVce6crDbmxP2MU7J4nw32mAa19lY1uKBr7%2Bn%2BkXPuW5ezKhf7msCoNCk1%2BoFSVAQ3mCI8rua%2B5maGlKvT9vya2SXKPu6YbnqqakDMeEgROtojzE%2BcwTpVoj86hKyamBt3576VEEfSw99c4k%2BTqJ%2B4kGshFC%2B2QARlCLMFldw%2FiSajSgHkwDHfhqdMk5j6mR%2B7fdccsylDaoksd8Q%3D' via {s}->https://download.encodeproject.org:443
2019/06/14 16:41:35:683 CEST [DEBUG] RequestAddCookies - CookieSpec selected: default
2019/06/14 16:41:35:684 CEST [DEBUG] RequestAuthCache - Auth cache not set in the context
2019/06/14 16:41:35:684 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection request: [route: {s}->https://download.encodeproject.org:443][total kept alive: 1; route allocated: 0 of 2; total allocated: 1 of 20]
2019/06/14 16:41:35:684 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection leased: [id: 1][route: {s}->https://download.encodeproject.org:443][total kept alive: 1; route allocated: 1 of 2; total allocated: 2 of 20]
2019/06/14 16:41:35:684 CEST [DEBUG] MainClientExec - Opening connection {s}->https://download.encodeproject.org:443
2019/06/14 16:41:35:718 CEST [DEBUG] DefaultHttpClientConnectionOperator - Connecting to download.encodeproject.org/34.211.244.144:443
2019/06/14 16:41:35:718 CEST [DEBUG] SSLConnectionSocketFactory - Connecting socket to download.encodeproject.org/34.211.244.144:443 with timeout 0
2019/06/14 16:41:35:872 CEST [DEBUG] SSLConnectionSocketFactory - Enabled protocols: [TLSv1, TLSv1.1, TLSv1.2]
2019/06/14 16:41:35:872 CEST [DEBUG] SSLConnectionSocketFactory - Enabled cipher suites:[TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA384, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDH_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDH_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDH_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDH_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
2019/06/14 16:41:35:873 CEST [DEBUG] SSLConnectionSocketFactory - Starting handshake
2019/06/14 16:41:36:198 CEST [DEBUG] SSLConnectionSocketFactory - Secure session established
2019/06/14 16:41:36:199 CEST [DEBUG] SSLConnectionSocketFactory -  negotiated protocol: TLSv1.2
2019/06/14 16:41:36:199 CEST [DEBUG] SSLConnectionSocketFactory -  negotiated cipher suite: TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
2019/06/14 16:41:36:199 CEST [DEBUG] SSLConnectionSocketFactory -  peer principal: CN=*.encodeproject.org, OU=Domain Control Validated
2019/06/14 16:41:36:199 CEST [DEBUG] SSLConnectionSocketFactory -  peer alternative names: [*.encodeproject.org, encodeproject.org]
2019/06/14 16:41:36:199 CEST [DEBUG] SSLConnectionSocketFactory -  issuer principal: CN=AlphaSSL CA - SHA256 - G2, O=GlobalSign nv-sa, C=BE
2019/06/14 16:41:36:200 CEST [DEBUG] DefaultHttpClientConnectionOperator - Connection established 172.18.240.255:34042<->34.211.244.144:443
2019/06/14 16:41:36:200 CEST [DEBUG] MainClientExec - Executing request HEAD /https:/encode-public.s3.amazonaws.com/2018/04/06/8723ee96-ccee-4384-b5a8-4040262283eb/ENCFF784GFP.hic?response-content-disposition=attachment%3B%20filename%3DENCFF784GFP.hic&AWSAccessKeyId=ASIATGZNGCNXXPJTPGFC&Signature=62geOTSamvi215asIZXzrTUDmkM%3D&Expires=1560652004&x-amz-security-token=AgoJb3JpZ2luX2VjEMb%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLXdlc3QtMiJHMEUCIDHIut1ySUl%2FZPI%2BB0Qbza4jT9SEXsEVkXEzc0uVQPx%2BAiEA%2FX8zEiJiQOWBbngRnBwL3Ha2nbI2r68cIc5GmQCbO7Mq4wMI7%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAAGgwyMjA3NDg3MTQ4NjMiDLmNazt7Uno3MzIF%2Biq3A9s3QhvDZZr5IlE84sTDkrv4xp2eSRBE8fiCTxDP1dVaYX4%2FvaJJmLDqN%2FJnf6lWyA58Uhku2unejkvT3ZTrt7xG5EuTBPcVF3NDU6ZACsHInRNtZHguvnqYUj2jGoM5CIo2wh5lWHEmtqzGfkIhkkk3%2BR65kWOU9Cu0GdBYpNzanewfyyV3YrjNhVLavnyve0%2FKPAWb0QEM1X1Epm0ayyYJpf1ZDLxrLdrUS%2FDCP25nkIoBBHafIJIkzWlgUJO%2B5PmRDsHDGtK%2F6yJHI9SVO3uUe8qlTlMMrSyhap8d16063sFHObfkUTmOpFJlaLjeOdk0P9IhJPSifcv%2FGRG1N1TtponOtS6uRpfTF%2B5oUn7bGx6lknMfMOHFi0v6DPY%2FxHDuUoTorvW%2FA%2B4kJEK3vBBc1FIbrGXKkb8EUUkgCJgtin8c6dsgUcoIHAMreiJ6v7XPLOoXGy6rlFCMbVKmJ%2BrIsBMBbkKdqk1MCOpT93uFmhyiiwKnTJJosd2Ib2JcW1quL7Eb5P6OO%2FemGhn1ti3bIY%2BBBZZCaqI8PWpd3QgPTdWA74vVWznihvdDgOT1CB9%2FszZPIpswttOO6AU6tAFB7R3%2B78X%2FUvRzE%2BVxZuQxAKsRna3iATiVce6crDbmxP2MU7J4nw32mAa19lY1uKBr7%2Bn%2BkXPuW5ezKhf7msCoNCk1%2BoFSVAQ3mCI8rua%2B5maGlKvT9vya2SXKPu6YbnqqakDMeEgROtojzE%2BcwTpVoj86hKyamBt3576VEEfSw99c4k%2BTqJ%2B4kGshFC%2B2QARlCLMFldw%2FiSajSgHkwDHfhqdMk5j6mR%2B7fdccsylDaoksd8Q%3D HTTP/1.1
2019/06/14 16:41:36:200 CEST [DEBUG] MainClientExec - Target auth state: UNCHALLENGED
2019/06/14 16:41:36:200 CEST [DEBUG] MainClientExec - Proxy auth state: UNCHALLENGED
2019/06/14 16:41:36:201 CEST [DEBUG] headers - http-outgoing-1 >> HEAD /https:/encode-public.s3.amazonaws.com/2018/04/06/8723ee96-ccee-4384-b5a8-4040262283eb/ENCFF784GFP.hic?response-content-disposition=attachment%3B%20filename%3DENCFF784GFP.hic&AWSAccessKeyId=ASIATGZNGCNXXPJTPGFC&Signature=62geOTSamvi215asIZXzrTUDmkM%3D&Expires=1560652004&x-amz-security-token=AgoJb3JpZ2luX2VjEMb%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLXdlc3QtMiJHMEUCIDHIut1ySUl%2FZPI%2BB0Qbza4jT9SEXsEVkXEzc0uVQPx%2BAiEA%2FX8zEiJiQOWBbngRnBwL3Ha2nbI2r68cIc5GmQCbO7Mq4wMI7%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARAAGgwyMjA3NDg3MTQ4NjMiDLmNazt7Uno3MzIF%2Biq3A9s3QhvDZZr5IlE84sTDkrv4xp2eSRBE8fiCTxDP1dVaYX4%2FvaJJmLDqN%2FJnf6lWyA58Uhku2unejkvT3ZTrt7xG5EuTBPcVF3NDU6ZACsHInRNtZHguvnqYUj2jGoM5CIo2wh5lWHEmtqzGfkIhkkk3%2BR65kWOU9Cu0GdBYpNzanewfyyV3YrjNhVLavnyve0%2FKPAWb0QEM1X1Epm0ayyYJpf1ZDLxrLdrUS%2FDCP25nkIoBBHafIJIkzWlgUJO%2B5PmRDsHDGtK%2F6yJHI9SVO3uUe8qlTlMMrSyhap8d16063sFHObfkUTmOpFJlaLjeOdk0P9IhJPSifcv%2FGRG1N1TtponOtS6uRpfTF%2B5oUn7bGx6lknMfMOHFi0v6DPY%2FxHDuUoTorvW%2FA%2B4kJEK3vBBc1FIbrGXKkb8EUUkgCJgtin8c6dsgUcoIHAMreiJ6v7XPLOoXGy6rlFCMbVKmJ%2BrIsBMBbkKdqk1MCOpT93uFmhyiiwKnTJJosd2Ib2JcW1quL7Eb5P6OO%2FemGhn1ti3bIY%2BBBZZCaqI8PWpd3QgPTdWA74vVWznihvdDgOT1CB9%2FszZPIpswttOO6AU6tAFB7R3%2B78X%2FUvRzE%2BVxZuQxAKsRna3iATiVce6crDbmxP2MU7J4nw32mAa19lY1uKBr7%2Bn%2BkXPuW5ezKhf7msCoNCk1%2BoFSVAQ3mCI8rua%2B5maGlKvT9vya2SXKPu6YbnqqakDMeEgROtojzE%2BcwTpVoj86hKyamBt3576VEEfSw99c4k%2BTqJ%2B4kGshFC%2B2QARlCLMFldw%2FiSajSgHkwDHfhqdMk5j6mR%2B7fdccsylDaoksd8Q%3D HTTP/1.1
2019/06/14 16:41:36:201 CEST [DEBUG] headers - http-outgoing-1 >> Host: download.encodeproject.org
2019/06/14 16:41:36:201 CEST [DEBUG] headers - http-outgoing-1 >> Connection: Keep-Alive
2019/06/14 16:41:36:201 CEST [DEBUG] headers - http-outgoing-1 >> User-Agent: Apache-HttpClient/4.5.9 (Java/1.8.0_191)
2019/06/14 16:41:36:202 CEST [DEBUG] headers - http-outgoing-1 >> Accept-Encoding: gzip,deflate
2019/06/14 16:41:36:354 CEST [DEBUG] headers - http-outgoing-1 << HTTP/1.1 404 Not Found
2019/06/14 16:41:36:355 CEST [DEBUG] headers - http-outgoing-1 << Server: nginx/1.14.1
2019/06/14 16:41:36:355 CEST [DEBUG] headers - http-outgoing-1 << Date: Fri, 14 Jun 2019 14:26:45 GMT
2019/06/14 16:41:36:355 CEST [DEBUG] headers - http-outgoing-1 << Content-Type: text/html
2019/06/14 16:41:36:355 CEST [DEBUG] headers - http-outgoing-1 << Content-Length: 169
2019/06/14 16:41:36:355 CEST [DEBUG] headers - http-outgoing-1 << Connection: keep-alive
2019/06/14 16:41:36:356 CEST [DEBUG] MainClientExec - Connection can be kept alive indefinitely
2019/06/14 16:41:36:356 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection [id: 1][route: {s}->https://download.encodeproject.org:443] can be kept alive indefinitely
2019/06/14 16:41:36:356 CEST [DEBUG] DefaultManagedHttpClientConnection - http-outgoing-1: set socket timeout to 0
2019/06/14 16:41:36:356 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection released: [id: 1][route: {s}->https://download.encodeproject.org:443][total kept alive: 2; route allocated: 1 of 2; total allocated: 2 of 20]
2019/06/14 16:41:36:357 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection manager is shutting down
2019/06/14 16:41:36:357 CEST [DEBUG] DefaultManagedHttpClientConnection - http-outgoing-1: Close connection
2019/06/14 16:41:36:358 CEST [DEBUG] DefaultManagedHttpClientConnection - http-outgoing-0: Close connection
2019/06/14 16:41:36:358 CEST [DEBUG] PoolingHttpClientConnectionManager - Connection manager shut down
[SEVERE][HicStraw]Unexpected Http status code HTTP/1.1 404 Not Found for "https://www.encodeproject.org/files/ENCFF784GFP/@@download/ENCFF784GFP.hic"
java.io.IOException: Unexpected Http status code HTTP/1.1 404 Not Found for "https://www.encodeproject.org/files/ENCFF784GFP/@@download/ENCFF784GFP.hic"
 

      setting the user-agent doesn't work.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            lindenb Lindenbaum
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: