Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-13071

Elasticsearch rest component should support scroll api

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.23.0
    • Fix Version/s: 2.24.0, 3.0.0
    • Labels:
      None
    • Estimated Complexity:
      Unknown

      Description

      On some projects we need to fetch all results from Elasticsearch.

      This is currently quite difficult.

      Here is an example of usage that could be implemented:

      ElasticsearchRouter.java
      from("direct:search")
        .to("elasticsearch-rest://elasticsearch?operation=Search&indexName=twitter&indexType=tweet&useScroll=true&scrollKeepAliveMs=30000")
        .split()
        .body()
        .streaming()
        .to("mock:output")
        .end();
      

      Two new parameters could be used:

      • useScroll: enable scroll usage
      • scrollKeepAliveMs: time in ms during which elasticsearch will keep search context alive

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                acosentino Andrea Cosentino
                Reporter:
                lboutros Ludovic Boutros
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m