[IGNITE-12262] Implement a Pub/Sub Data Streamer

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.6
• Component/s: streaming
• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Emmanouil Gkatziouras
• Reporter: Emmanouil Gkatziouras
• Created: 04/Oct/19 22:56
• Updated: 29/Dec/19 18:35
• Resolved: 29/Dec/19 18:35

Description

A Pub/Sub data streamer would assist GCP users to consume data and feed them into an Ignite cache.

This data streamer will instantiate a Pub/Sub consumer endpoint,

The user will specify and apply a StreamTransformer to the incoming Exchange which shall add the result to the data streamer.

The streamer will register as a subscriber and will listen to incoming messages.
The same subscriber Id shall be used for all nodes.
Only one subscriber/node will process an incoming message, instead of every subscriber receiving the same message

Issue Links

• relates to: IGNITE-12355 [Umbrella] IEP-36 Modularization
• links to: GitHub Pull Request #2