Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
We have IgniteDataStreamer which is used to load data into Ignite under high load. It was previously named IgniteDataLoader, see ticket IGNITE-394.
We should create IgniteTwitterStreamer which will consume messages from Twitter and stream them into Ignite caches.
More details to follow, but to the least we should be able to:
- Convert Twitter data to Ignite data using an optional pluggable converter.
- Specify the cache name for the Ignite cache to load data into.
- Specify other flags available on IgniteDataStreamer class.