[CONNECTORS-1546] Optimize Elasticsearch performance by removing 'forcemerge'

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: ManifoldCF 2.12
• Component/s: Elastic Search connector
• Assignee: Steph van Schalkwyk
• Reporter: Hans Van Goethem
• Created: 16/Oct/18 13:19
• Updated: 03/Dec/18 16:52
• Resolved: 03/Dec/18 16:52

Description

After crawling with ManifoldCF, forcemerge is applied to optimize the Elasticsearch index. This optimization makes the Elastic faster for read-operations but not for write-opeartions. On the contrary, performance on the write operations becomes worse after every forcemerge.

Can you remove this forcemerge in ManifoldCF to optimize perfomance for recurrent crawling to Elasticsearch?

If somene needs this forcemerge, it can be applied mannually against Elasticsearch directly.