[NUTCH-2492] Add more configuration parameters to crawl script

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15
• Assignee: Moreno Feltscher
• Reporter: Moreno Feltscher
• Created: 03/Jan/18 23:30
• Updated: 01/Oct/19 14:29
• Resolved: 08/Jan/18 11:50

Description

Instead of having to copy and adjust the crawl script in order to specify the following configuration options allow the user to pass them in using arguments:

• numSlaves
• numTasks
• sizeFetchlist
• timeLimitFetch
• numThreads

Issue Links

• links to: GitHub Pull Request #271