Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-108 Redesign of Ignite Streaming
  3. IGNITE-536

Implement IgniteKinesisStreamer to stream data from Amazon Kinesis service

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: streaming
    • Labels:
      None

      Description

      We have IgniteDataStreamer which is used to load data into Ignite under high load. It was previously named IgniteDataLoader, see ticket IGNITE-394.

      See Amazon Kinesis site for more info.

      We should create IgniteKinesisStreamer which will consume messages from Amazon Kinesis and stream them into Ignite caches.

      More details to follow, but to the least we should be able to:

      • Convert Kinesis messages to Ignite data using an optional pluggable converter. If not provided, we should have some default mechanism.
      • Specify the cache name for the Ignite cache to load data into.
      • Specify other flags available on IgniteDataStreamer class.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              dsetrakyan Dmitriy Setrakyan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: