[NUTCH-2880] parse-html/tika: update/complete HTML elements to extract outlinks from

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.18
• Fix Version/s: 1.21
• Component/s: parser, plugin
• Labels: help-wanted
• Assignee: Unassigned
• Reporter: Sebastian Nagel
• Created: 18/Jun/21 08:52
• Updated: 30/Mar/24 17:19

Description

The list of HTML elements used to extract outlinks from (in DOMContentUtils (parse-html) and DOMContentUtils (parse-tika)) needs to be updated/completed to include HTML elements common in HTML5. Cf. a related question on stackoverflow about the <object> element

A (mostly?) up-to-date list of HTML elements could be taken from the extractor of iipc/webarchiv-commons.