[NUTCH-444] Possibly use a different library to parse RSS feed for improved performance and compatibility

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 1.0.0
• Component/s: fetcher
• Assignee: Chris A. Mattmann
• Reporter: Renaud Richardet
• Created: 09/Feb/07 23:41
• Updated: 10/Apr/09 12:29
• Resolved: 19/Jun/07 14:02

Description

As discussed by Nutch Newbie, Gal, and Chris on NUTCH-443, the current library (feedparser) has the following issues:

• OutOfMemory when parsing > 100k feeds, since it has to convert the feed to jdom first
• no support for Atom 1.0
• there has been no development in the last year

Alternatives are:

• Rome
• Informa
• custom implementation based on Stax
• ??