[CONNECTORS-604] Header differences from ManifoldCF 1.0.1 cause some crawls to fail

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: ManifoldCF 1.1
• Fix Version/s: ManifoldCF 1.1
• Component/s: Elastic Search connector, LiveLink connector, Meridio connector, RSS connector, SharePoint connector, Web connector, Wiki connector
• Assignee: Karl Wright
• Reporter: Karl Wright
• Created: 09/Jan/13 15:05
• Updated: 14/Jan/13 02:04
• Resolved: 14/Jan/13 02:04

Description

Certain sites that were crawlable before with MCF 1.0.1 fail with trunk. Analysis shows that the differences are due to the Host header (which includes an explicit port in trunk but not in MCF 1.0.1) and an "Accept: /" header in MCF 1.0.1 that is not present in trunk.