[CONNECTORS-1193] Consider adding feature to web connector to skip pages that match specified criteria

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: ManifoldCF 1.10, ManifoldCF 2.2
• Fix Version/s: ManifoldCF 1.10, ManifoldCF 2.2
• Component/s: Web connector
• Assignee: Karl Wright
• Reporter: Karl Wright
• Created: 30/Apr/15 07:25
• Updated: 28/May/15 23:29
• Resolved: 26/May/15 10:41

Description

The user wants to skip content that matches specified criteria, because some sites don't return a 404 code (for instance) but instead return 200 with a textual error message.