[CAMEL-13071] Elasticsearch rest component should support scroll api

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.23.0
• Fix Version/s: 2.24.0, 3.0.0
• Component/s: camel-elasticsearch-rest
• Estimated Complexity: Unknown
• Assignee: Andrea Cosentino
• Reporter: Ludovic Boutros
• Created: 16/Jan/19 11:22
• Updated: 17/Jan/19 10:47
• Resolved: 17/Jan/19 10:47

Description

On some projects we need to fetch all results from Elasticsearch.

This is currently quite difficult.

Here is an example of usage that could be implemented:

ElasticsearchRouter.java

from("direct:search")
  .to("elasticsearch-rest://elasticsearch?operation=Search&indexName=twitter&indexType=tweet&useScroll=true&scrollKeepAliveMs=30000")
  .split()
  .body()
  .streaming()
  .to("mock:output")
  .end();

Two new parameters could be used:

• useScroll: enable scroll usage
• scrollKeepAliveMs: time in ms during which elasticsearch will keep search context alive

Issue Links

• links to: GitHub Pull Request #2710