Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36145

Remove Python 3.6 support in codebase and CI

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Done
    • 3.3.0
    • None
    • PySpark

    Description

      Python 3.6 is deprecated via SPARK-35938 at Apache Spark 3.2. We should remove it in Spark 3.3.

      This JIRA also target to all the changes in CI and development not only user-facing changes.

      Attachments

        Issue Links

          Activity

            gurwls223 Hyukjin Kwon added a comment - - edited

            Oh, this JIRA actually targets to remove Python 3.9 out e.g. in the documentation too. I will track and make sure to resolve it before Spark 3.3

            gurwls223 Hyukjin Kwon added a comment - - edited Oh, this JIRA actually targets to remove Python 3.9 out e.g. in the documentation too. I will track and make sure to resolve it before Spark 3.3
            srowen Sean R. Owen added a comment -

            Is this one all done now?

            srowen Sean R. Owen added a comment - Is this one all done now?
            dongjoon Dongjoon Hyun added a comment -

            Thank you, hyukjin.kwon!

            dongjoon Dongjoon Hyun added a comment - Thank you, hyukjin.kwon !
            gurwls223 Hyukjin Kwon added a comment - - edited
            gurwls223 Hyukjin Kwon added a comment - - edited cc ueshin itholic XinrongM smilegator FYI
            gurwls223 Hyukjin Kwon added a comment - - edited

            dongjoon, I just made an umbrella ticket here to track it. Hope this is fine for you.

            gurwls223 Hyukjin Kwon added a comment - - edited dongjoon , I just made an umbrella ticket here to track it. Hope this is fine for you.

            People

              zero323 Maciej Szymkiewicz
              gurwls223 Hyukjin Kwon
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: