[ANY23-75] Improve runtime of the Microdata extractor on documents with many relations.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Fix Version/s: 0.7.0
• Assignee: Michele Mostarda
• Reporter: Timothy Potter
• Created: 12/Apr/12 16:35
• Updated: 25/Jun/12 16:52
• Resolved: 01/Jun/12 13:13

Description

I've been running Any23 on a big web crawler dump. I found for certain documents with a lot of Microdata relations the method MicrodataParser.getItemProps() becomes very slow. As a result, processing one document can take several minutes. An example of a problematic page can be seen here: http://dreamtime.fftunes.com/

I'll attach a patch for the method that greatly improves the performance of this method. I was wondering if someone could have a look at it and include it in the next release if possible.

Issue Links

• duplicates: ANY23-77 Facing a infinite loop problem in version 0.6.1 - Verify