Uploaded image for project: 'PredictionIO (Retired)'
  1. PredictionIO (Retired)
  2. PIO-90

Improve /batch/events.json endpoint performance

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0-incubating
    • None
    • None

    Description

      It's possible to improve /batch/events.json endpoint of the event server performance by using batch inserting in storage implementations. For example, Elasticsearch has bulk API and also JDBC has batch updating.

      I propose adding LEvent.futureInsertBatch() that takes Seq[Event] and modify /batch/events.json endpoint to use it. The default implementation is calling existing futureInsert() per event, and we can override it in the storage implementation to use storage specific batch inserting API.

      Attachments

        Issue Links

          Activity

            People

              takezoe Naoki Takezoe
              takezoe Naoki Takezoe
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment