[DROIDS-55] create a droids-crawler module and move any crawler specific class from core

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.1.0
• Assignee: Tobias Rübner
• Reporter: Mingfai Ma
• Created: 17/Jul/09 09:55
• Updated: 25/Sep/12 09:33
• Resolved: 25/Sep/12 09:33

Description

1. create a new module in svn, move any crawler specific code to the module.
https://svn.apache.org/repos/asf/incubator/droids/trunk/droids-crawler

2. create a JIRA component for crawler

3. define what should be in core and what should be in crawler.

• stuff like task, taskmaster, queue will be in core
• stuff like fetcher/parser maybe in core or crawler
• stuff like link extractor are crawler specific and should go to droids-crawler

Issue Links

• duplicates: DROIDS-107 Module reorganization and trunk cleaning