Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37244

Build and test on Python 3.10

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • PySpark
    • None

    Description

      Python 3.10 introduced breaking changes. We need to update PySpark.

      For example, the following.

      >>> from collections import Callable
      <stdin>:1: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working
      

      This is targeting Apache Spark 3.3.0 in 2022.

      Attachments

        Issue Links

          Activity

            People

              dongjoon Dongjoon Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: