[NUTCH-2504] Results of maxCountExpr and fetchDelayExpr should be stored in memory in Generate

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.15
• Fix Version/s: 1.21
• Component/s: generator
• Assignee: Unassigned
• Reporter: Semyon Semyonov
• Created: 25/Jan/18 14:54
• Updated: 30/Mar/24 17:19

Description

With NUTCH-2455 the expressions maxCountExpr and fetchDelayExpr are calculated for each value. That slows the process, instead we can store the results for each host in hostDomainCounts. 

That will take only 2 x sizeof(long) extra memory per host.