[IGNITE-7077] Spark Data Frame Support. Strategy to convert complete query to Ignite SQL

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3
• Fix Version/s: 2.5
• Component/s: spark
• Labels: bigdata
• Assignee: Nikolay Izhikov
• Reporter: Nikolay Izhikov
• Created: 30/Nov/17 07:59
• Updated: 02/Sep/18 17:28
• Resolved: 20/Apr/18 09:04

Description

Basic support of Spark Data Frame for Ignite implemented in IGNITE-3084.

We need to implement custom spark strategy that can convert whole Spark SQL query to Ignite SQL Query if query consists of only Ignite tables.
The strategy does nothing if spark query includes not only Ignite tables.

Memsql implementation can be taken as an example - https://github.com/memsql/memsql-spark-connector

Issue Links

• requires: IGNITE-3084 Spark Data Frames Support in Apache Ignite
• links to: GitHub Pull Request #3397