[SPARK-35684] Bump up mypy version in GitHub Actions

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: PySpark, Tests
• Assignee: Haejoon Lee
• Reporter: Hyukjin Kwon
• Created: 09/Jun/21 01:08
• Updated: 12/Dec/22 18:10
• Resolved: 07/Jul/21 04:27

Description

The mypy version was pinned at https://issues.apache.org/jira/browse/SPARK-35682 but not the latest version because of the errors below:

python/pyspark/pandas/indexes/base.py:2007: error: Argument 1 to "from_tuples" of "MultiIndex" has incompatible type "Index"; expected "List[Tuple[Any, ...]]"
python/pyspark/testing/pandasutils.py:41: error: Library stubs not installed for "tabulate" (or incompatible with Python 3.6)
python/pyspark/testing/pandasutils.py:41: note: Hint: "python3 -m pip install types-tabulate"
python/pyspark/testing/pandasutils.py:41: note: (or run "mypy --install-types" to install all missing stub packages)
python/pyspark/testing/pandasutils.py:41: note: See https://mypy.readthedocs.io/en/stable/running_mypy.html#missing-imports
Found 2 errors in 2 files (checked 312 source files)

This is blocked by https://issues.apache.org/jira/browse/SPARK-35683

Issue Links

• is related to: SPARK-35683 Fix Index.difference to avoid collect 'other' to driver side
• relates to: SPARK-35682 Pin mypy version in GitHub Actions CI
• links to: [Github] Pull Request #33223 (HyukjinKwon)