[NUTCH-272] Max. pages to crawl/fetch per site (emergency limit)

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Assignee: Unassigned
• Reporter: Stefan Neufeind
• Created: 19/May/06 22:06
• Updated: 01/Apr/11 14:56
• Resolved: 01/Apr/11 14:56

Description

If I'm right, there is no way in place right now for setting an "emergency limit" to fetch a certain max. number of pages per site. Is there an "easy" way to implement such a limit, maybe as a plugin?