[NUTCH-1089] short compressed pages caused Exception

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Labels: patch
• Patch Info: Patch Available
• Assignee: Unassigned
• Reporter: simone frenzel
• Created: 23/Aug/11 14:49
• Updated: 01/Oct/13 12:04
• Resolved: 23/Aug/11 15:52

Description

Hi,

tested nutch on compressed pages, and on pages with Basic Auth and compression. On short compressed pages this Exception is thrown:

2011-08-19 17:06:55,190 ERROR httpclient.Http - java.io.IOException: unzipBestEffort returned null
2011-08-19 17:06:55,190 ERROR httpclient.Http - at org.apache.nutch.protocol.http.api.HttpBase.processGzipEncoded(HttpBase.java:310)
2011-08-19 17:06:55,191 ERROR httpclient.Http - at org.apache.nutch.protocol.httpclient.HttpResponse.<init>(HttpResponse.java:163)
2011-08-19 17:06:55,191 ERROR httpclient.Http - at org.apache.nutch.protocol.httpclient.Http.getResponse(Http.java:154)
2011-08-19 17:06:55,191 ERROR httpclient.Http - at org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:138)
2011-08-19 17:06:55,191 ERROR httpclient.Http - at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:628)

In same cases Basic Auth failt also.

Works fine with the patch.

Issue Links

• is related to: NUTCH-1647 protocol-http throws 'unzipBestEffort returned null' for redirected pages