[SPARK-36985] Future typing errors in pyspark.pandas

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: PySpark
• Assignee: Takuya Ueshin
• Reporter: Maciej Szymkiewicz
• Created: 12/Oct/21 10:13
• Updated: 12/Dec/22 18:11
• Resolved: 13/Oct/21 01:25

Description

The following problems are detected on master with mypy 0.920

$ git rev-parse HEAD             
36b3bbc0aa9f9c39677960cd93f32988c7d7aaca
$ mypy --version                 
mypy 0.920+dev.332b712df848cd242987864b38bd237364654532
$ mypy --config-file mypy.ini pyspark
pyspark/pandas/indexes/base.py:184: error: Incompatible types in assignment (expression has type "CategoricalIndex", variable has type "MultiIndex")  [assignment]
pyspark/pandas/indexes/base.py:188: error: Incompatible types in assignment (expression has type "Int64Index", variable has type "MultiIndex")  [assignment]
pyspark/pandas/indexes/base.py:192: error: Incompatible types in assignment (expression has type "Float64Index", variable has type "MultiIndex")  [assignment]
pyspark/pandas/indexes/base.py:197: error: Incompatible types in assignment (expression has type "DatetimeIndex", variable has type "MultiIndex")  [assignment]
pyspark/pandas/indexes/base.py:199: error: Incompatible types in assignment (expression has type "Index", variable has type "MultiIndex")  [assignment]
pyspark/pandas/indexes/base.py:201: error: "MultiIndex" has no attribute "_anchor"  [attr-defined]

Issue Links

• links to: [Github] Pull Request #34266 (ueshin)
• links to: [Github] Pull Request #34266 (ueshin)