Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3333

Create Elasticsearch IO compatible with ES 6.x

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: io-java-elasticsearch
    • Labels:
      None

      Description

      The current Elasticsearch IO is only compatible with Elasticsearch v 2.x and v 5.x. The aim is to have an IO compatible with ES v 6.x. Beyond being able to address v6.x elasticsearch instances, we could also leverage the use of the Elasticsearch pipeline API and also better split the dataset (be as close as possible of desiredBundleSize) thanks to the new ES split API that allows ES shards splitting.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                echauchot Etienne Chauchot
                Reporter:
                f.wal@rechtspraak.nl Fokko van der Wal
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: