[NUTCH-1342] Read time out protocol-http

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.4, 1.5
• Component/s: protocol
• Patch Info: Patch Available
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 20/Apr/12 09:39
• Updated: 28/Jan/21 14:03
• Resolved: 01/Oct/19 13:29

Description

For some reason some URL's always time out with protocol-http but not protocol-httpclient. The stack trace is always the same:

2012-04-20 11:25:44,275 ERROR http.Http - Failed to get protocol output
java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:129)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        at java.io.FilterInputStream.read(FilterInputStream.java:116)
        at java.io.PushbackInputStream.read(PushbackInputStream.java:169)
        at java.io.FilterInputStream.read(FilterInputStream.java:90)
        at org.apache.nutch.protocol.http.HttpResponse.readPlainContent(HttpResponse.java:228)
        at org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:157)
        at org.apache.nutch.protocol.http.Http.getResponse(Http.java:64)
        at org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:138)

Some example URL's:

• 404 http://www.fcgroningen.nl/tribunenamen/stemmen/
• 301 http://shop.fcgroningen.nl/aanbieding

Issue Links

• is related to: NUTCH-1825 protocol-http may hang for certain web pages