[CONNECTORS-1653] Solr ingester connector contribution

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: ManifoldCF 2.18
• Flags: Patch
• Assignee: Karl Wright
• Reporter: Olivier Tavard
• Created: 21/Sep/20 15:20
• Updated: 11/Dec/20 18:04
• Resolved: 21/Nov/20 13:04

Description

Hi,

We developed a new repository connector for crawling data from Solr and we would like to contribute to MCF by releasing the code into Apache v2 license.

The goal of this connector is to crawl Solr instances and manage it in MCF rather than using DIH for instance.
So to do it, we send requests to Solr and we manage the large number of results thanks to the cursormark. The Solr fields must be stored in order to be gathered.

By the way we do not use any specific libraries, all the dependencies are already into MCF. We tested it so far for Solr 7 and 8 versions.

The documentation is here : https://datafari.atlassian.net/wiki/spaces/DATAFARI/pages/673742849/Solr+ingester+crawler+connector

The code is attached.

Best regards,

Olivier Tavard