[NUTCH-2461] Generate passes the data to when maxCount == 0

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.14
• Fix Version/s: 1.15
• Component/s: generator
• Assignee: Unassigned
• Reporter: Semyon Semyonov
• Created: 14/Nov/17 13:40
• Updated: 01/Oct/19 14:30
• Resolved: 15/Jan/18 17:40

Description

The generator checks condition
if (maxCount > 0) : line 421 and stop the generation when amount per host exceeds maxCount( continue : line 455)
but when maxCount == 0 it goes directly to line 465 :output.collect(key, entry);

It is obviously not correct, the correct solution would be to add
if(maxCount == 0)

{ continue; }

at line 380.

Issue Links

• blocks: NUTCH-2368 Variable generate.max.count and fetcher.server.delay
• links to: GitHub Pull Request #249