[NUTCH-2202] Integration of Anthelion (Focused Crawling Module) into Nutch

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: parser, scoring
• Labels: any23 online_learning
• External issue ID: https://github.com/yahoo/anthelion/issues/1
• Assignee: Lewis John McGibbney
• Reporter: Robert Meusel
• Created: 19/Jan/16 09:08
• Updated: 25/Nov/19 03:32

Description

We have recently released anthelion, which is a focused crawler plugin for structured data which can be extracted with any23. (https://github.com/yahoo/anthelion) As proposed by Lewis (Lewis John McGibbney) we think the integration of the parser (any23) and the scoring function based on the online learner could be a good improvement for nutch.

Issue Links

• links to: GitHub Pull Request #97