[NUTCH-2059] protocol-httpclient, protocol-http unit test errors on Jenkins

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11
• Component/s: fetcher
• Assignee: Chris A. Mattmann
• Reporter: Peter Ciuffetti
• Created: 04/Jul/15 20:27
• Updated: 13/Mar/24 14:50
• Resolved: 08/Aug/15 20:29

Description

This is an occasional error on the build of the Nutch trunk visible in Jenkins builds. It happens on either protocol-http or protocol-httpclient, which can be running at the same time given the multi-threaded test setup.

[junit] Running org.apache.nutch.protocol.httpclient.TestProtocolHttpClient
[junit] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.377 sec
[junit] Test org.apache.nutch.protocol.http.TestProtocolHttp FAILED

Evidence of failure on Jenkins go back to
Failed > Console Output #3154 Jun 8, 2015 4:00:00 AM
https://builds.apache.org/view/All/job/Nutch-trunk/3154/consoleFull

And are repeated at...
https://builds.apache.org/view/All/job/Nutch-trunk/3190/console
https://builds.apache.org/view/All/job/Nutch-trunk/3189/console

Some possibly related tickets
NUTCH-1836 Timeouts in protocol-httpclient when crawling same host with >2 threads

NUTCH-1086 Rewrite protocol-httpclient

The unit tests are not failing for me on my sandbox, but there are some exceptions being output to the log related to headers being sent on JSP pages after the response writer is invoked.

java.lang.IllegalStateException: STREAM
        at org.mortbay.jetty.Response.getWriter(Response.java:616)

Issue Links

• is related to: NUTCH-1086 Rewrite protocol-httpclient
• is related to: NUTCH-2052 Enhance index-static to allow configurable delimiters