[SPARK-42709] Do not rely on __file__

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: PySpark
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 08/Mar/23 05:09
• Updated: 08/Mar/23 18:00
• Resolved: 08/Mar/23 18:00

Description

We have a lot of places using _file_ which is actually optional. We shouldn't reply on them

Issue Links

• links to: [Github] Pull Request #40328 (HyukjinKwon)