Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-7077

Spark Data Frame Support. Strategy to convert complete query to Ignite SQL

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3
    • Fix Version/s: 2.5
    • Component/s: spark
    • Labels:

      Description

      Basic support of Spark Data Frame for Ignite implemented in IGNITE-3084.

      We need to implement custom spark strategy that can convert whole Spark SQL query to Ignite SQL Query if query consists of only Ignite tables.
      The strategy does nothing if spark query includes not only Ignite tables.

      Memsql implementation can be taken as an example - https://github.com/memsql/memsql-spark-connector

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                NIzhikov Nikolay Izhikov
                Reporter:
                NIzhikov Nikolay Izhikov
              • Votes:
                1 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: