Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-9357

Spark Structured Streaming with Ignite as data source and sink

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0
    • Fix Version/s: None
    • Component/s: spark
    • Labels:
      None
    • Ignite Flags:
      Docs Required

      Description

      We are working on a PoC where we want to use Ignite as a data storage and Spark as a computation engine. We found that Ignite is supported neither as a source nor as a Sink when using Spark Structured Streaming, which is a must for us.

      We are enhancing Ignite to support Spark streaming with Ignite. We will send docs and code for review for the Ignite Community to consider if the community wants to accept this feature. 

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kukushal Alexey Kukushkin
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10m
                10m