[NUTCH-1465] Support sitemaps in Nutch

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14
• Component/s: parser
• Assignee: Markus Jelsma
• Reporter: Lewis John McGibbney
• Created: 04/Sep/12 13:57
• Updated: 13/Mar/24 14:51
• Resolved: 19/Jul/17 11:25

Description

I recently came across this rather stagnant codebase[0] which is ASL v2.0 licensed and appears to have been used successfully to parse sitemaps as per the discussion here[1].

[0] http://sourceforge.net/projects/sitemap-parser/
[1] http://lucene.472066.n3.nabble.com/Support-for-Sitemap-Protocol-and-Canonical-URLs-td630060.html

Issue Links

• is related to: NUTCH-1622 Create Outlinks with metadata
• is related to: NUTCH-1741 Support of Sitemaps in Nutch 2.x
• links to: GitHub Pull Request #189