[SPARK-37395] Inline type hint files for files in python/pyspark/ml

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: ML, PySpark
• Epic Link: Type Hints Inline
• Assignee: Maciej Szymkiewicz
• Reporter: Maciej Szymkiewicz
• Created: 20/Nov/21 09:44
• Updated: 03/Jun/22 05:02
• Resolved: 14/Apr/22 19:50

Description

Currently there are type hint stub files (*.pyi) to show the expected types for functions, but we can also take advantage of static type checking within the functions by inlining the type hints.

Issue Links

• is blocked by: SPARK-37094 Inline type hints for files in python/pyspark
• is related to: SPARK-36845 Inline type hint files for files in python/pyspark/sql
• is related to: SPARK-37093 Inline type hints python/pyspark/streaming
• is related to: SPARK-37094 Inline type hints for files in python/pyspark
• is related to: SPARK-37396 Inline type hint files for files in python/pyspark/mllib
• relates to: SPARK-36845 Inline type hint files for files in python/pyspark/sql