[CONNECTORS-606] ElasticSearch connector does not use background thread for http communication, and should

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: ManifoldCF 1.0.1
• Fix Version/s: ManifoldCF 1.1.1
• Component/s: Elastic Search connector
• Assignee: Karl Wright
• Reporter: Karl Wright
• Created: 10/Jan/13 08:59
• Updated: 08/Feb/13 16:05
• Resolved: 08/Feb/13 16:05

Description

The Elastic Search connector communicates using httpcomponent without going via a background thread. This is a problem because any socket waits on an elastic search server will block ManifoldCF agents shutdown.

Please see the RSS connector, web connector, livelink connector, or SharePoint connector for an example of proper use of background threading for http communication. The Livelink connector is the simplest.

It is also important to never load entire documents into memory, but stream them instead.