Add support for Content-Encoding: deflated

• Key: NUTCH-345
• Type: Improvement
• Status: Closed
• Resolution: Fixed
• Priority: Minor
• Assignee: Andrzej Bialecki
• Reporter: Pascal Beis
• Component/s: fetcher
• Affects Version/s: 0.9.0
• Fix Version/s: 1.0.0

Description

Add support for the "deflated" content-encoding, next to the already
implemented GZIP content-encoding. Patch attached. See also the
"Patch: deflate encoding" thread on nutch-dev on August 7/8 2006.

Comments

[Stefan Groschupf]

Shouldn't the DeflateUtils also be part of the protocol-http plugin?
Also since it is a larger contribution and not just a small bug fix it would be great to have a junit test within the patch.
Thanks for the contribution.

The DeflateUtils are called by HttpBase in the lib-http plugin, which in turn is called by
HttpResponse in the protocol-http plugin. Maybe you mean it should also be a part of
the protocol-httpclient plugin?

I'll look into providing a junit test.

Cheers

Pascal

[Andrzej Bialecki]

Looks ok to me. Minor addition - protocol-httpclient Http.java and HttpResponse.java should be modified too, to indicate that we support this encoding.

[Andrzej Bialecki]

Fixed in rev. 697878. Sorry for the long wait, and thank you!