Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12054

[Umbrella][Spark] Upgrade Spark module to 2.4

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: In Progress
    • Priority: Blocker
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 2.9
    • Component/s: spark
    • Labels:
    • Ignite Flags:
      Docs Required, Release Notes Required

      Description

      Users can't use APIs that are already available in Spark 2.4:
      https://stackoverflow.com/questions/57392143/persisting-spark-dataframe-to-ignite

      Let's upgrade Spark from 2.3 to 2.4 until we extract the Spark Integration as a separate module that can support multiple Spark versions.

        Attachments

        1. ignite-spark-patch-new.diff
          13 kB
          Shenson Joseph

          Issue Links

            Activity

              People

              • Assignee:
                zaleslaw Alexey Zinoviev
                Reporter:
                dmagda Denis A. Magda
              • Votes:
                2 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m