[SPARK-37902] Update annotations to resolve issues detected with mypy==0.931

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: PySpark
• Assignee: Maciej Szymkiewicz
• Reporter: Maciej Szymkiewicz
• Created: 13/Jan/22 21:11
• Updated: 14/Jan/22 19:53
• Resolved: 14/Jan/22 19:53

Description

The following new issues are detected when type checked with mypy==0.931

python/pyspark/pandas/base.py:879: error: "Sequence[Any]" has no attribute "tolist"  [attr-defined]
python/pyspark/sql/tests/test_pandas_udf_typehints_with_future_annotations.py:268: error: Incompatible return value type (got "floating[Any]", expected "float")  [return-value]
python/pyspark/sql/tests/test_pandas_udf_typehints.py:265: error: Incompatible return value type (got "floating[Any]", expected "float")  [return-value]

Issue Links

• links to: [Github] Pull Request #35199 (zero323)