[NUTCH-844] Improve NutchConfiguration

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: nutchgora
• Fix Version/s: nutchgora
• Patch Info: Patch Available
• Assignee: Andrzej Bialecki
• Reporter: Andrzej Bialecki
• Created: 08/Jul/10 12:59
• Updated: 22/May/13 03:53
• Resolved: 14/Jul/10 14:41

Description

This patch cleans up NutchConfiguration from servlet dependency, and modifies the API to allow bootstrapping via API from Properties. This is important for use cases where Nutch is embedded in a larger application.

Also, while I'm at it, remove the support for alternative "crawl" configuration when running Crawl tool, which has always been a source of confusion.

Issue Links

• incorporates: NUTCH-356 Plugin repository cache can lead to memory leak
• incorporates: NUTCH-925 plugins stored in weakhashmap lead memory leak