Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-38680

Set upperbound for pandas-stubs in CI

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • Project Infra
    • None

    Description

      e.g., ) https://github.com/apache/spark/runs/5729037000?check_suite_focus=true

      starting mypy annotations test...
      annotations failed mypy checks:
      python/pyspark/pandas/ml.py:62: error: Incompatible types in assignment (expression has type "Index", variable has type "MultiIndex")  [assignment]
      python/pyspark/pandas/frame.py:6133: error: unused "type: ignore" comment
      python/pyspark/pandas/frame.py:6292: error: Incompatible types in assignment (expression has type "Index", variable has type "MultiIndex")  [assignment]
      Found 3 errors in 2 files (checked 325 source files)
      

      Seems like the new release of pandas-stubs has a breaking change.

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            hyukjin.kwon Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: