Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-7400

Build phoenix-spark artifact with spark scala supported version

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • connectors, spark-connector
    • None

    Description

      Actually, phoenix5-spark is compatible with scala 2.11 and phoenix5-spark3 is compatible with scala 2.12.
      phoenix5-spark has dependency to spark 2.4.8 wich released with scala 2.11 and 2.12.

      phoenix5-spark3 has dependency to spark 3.2.4 wich released with scala 2.12 and 2.13.

      Since scala versions are not compatible, actual phoenix5-spark wont run with spark 2.4.8 compiled with scala 2.12.

      Same for  phoenix5-spark3 it can't be used with spark 3.2.4 compiled with scala 2.13.

      The goal of this ticket is to modify build phase to provide jars that are compatible with both spark versions as follow :

      • Build two jars of phoenix5-spark and phoenix5-spark-shaded one using scala 2.11 and the other 2.12.
      • Build two jars of  phoenix5-spark3 and phoenix5-spark3-shaded one using scala 2.12 and the other 2.13.

      Attachments

        Activity

          People

            rbr216 rejeb ben rejeb
            rbr216 rejeb ben rejeb
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: