[NUTCH-2004] ParseChecker does not handle redirects

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.9
• Fix Version/s: 1.11
• Labels: memex
• Assignee: Michael Joyce
• Reporter: Michael Joyce
• Created: 29/Apr/15 19:29
• Updated: 13/Mar/24 14:50
• Resolved: 06/May/15 23:33

Description

At the moment ParseChecker doesn't handle redirects. If it gets anything but a success status it errors out. It would be nice if it handled redirects a bit more gracefully based on the http.redirects config setting.