[IGNITE-12054] [Umbrella][Spark] Upgrade Spark module to 2.4

• Type: New Feature
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: spark
• Labels: important
• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Alexey Zinoviev
• Reporter: Denis A. Magda
• Created: 08/Aug/19 18:07
• Updated: 20/Nov/24 18:22

Description

Users can't use APIs that are already available in Spark 2.4:
https://stackoverflow.com/questions/57392143/persisting-spark-dataframe-to-ignite

Let's upgrade Spark from 2.3 to 2.4 until we extract the Spark Integration as a separate module that can support multiple Spark versions.

Issue Links

• relates to: BIGTOP-3286 Bump Ignite to 2.7.6
• links to: GitHub Pull Request #6909

Sub-Tasks

• [Spark] Support of Null Handling in JOIN condition: Open
• [Spark] Add initial support of Spark 2.4: Resolved