[SPARK-32319] Disallow the use of unused imports

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0
• Component/s: PySpark
• Assignee: Fokko Driesprong
• Reporter: Fokko Driesprong
• Created: 15/Jul/20 08:06
• Updated: 26/Oct/20 11:13
• Resolved: 08/Aug/20 15:52

Description

We don't want to import stuff that we're not going to use, to reduce the memory pressure.

Issue Links

• is required by: SPARK-17333 Make pyspark interface friendly with mypy static analysis
• links to: [Github] Pull Request #29121 (Fokko)
• links to: [Github] Pull Request #29121 (Fokko)