[NUTCH-1194] Generator: CrawlDB lock should be released earlier

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.17
• Component/s: generator
• Patch Info: Patch Available
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 02/Nov/11 17:42
• Updated: 28/Jan/21 13:16
• Resolved: 05/May/20 12:10

Description

Lock on the CrawlDB is released when everything is finished. But when generating many segments, the lock remains in place while it's not neccessary anymore. If GENERATE_UPDATE_DB is false we can release the lock immediately after the selector has finished.

Issue Links

• links to: GitHub Pull Request #514