[NUTCH-1318] Parse time outs crash parsing fetcher

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.4
• Fix Version/s: 1.6
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 20/Mar/12 19:24
• Updated: 22/May/13 03:53
• Resolved: 12/Jun/12 11:30

Description

Some fetch lists can never be fetched and parsed successfully because a single timing out record can cause most and eventually all subsequeny records to time out as well. Finally the mapper will hang completely and so killing the entire fetch job, loosing 99% of the records that were processed.

I'm not sure what's going on, something may be leaking somewhere.

Issue Links

• duplicates: NUTCH-1387 All parsers should respond to cancellation / interrupts.