[SPARK-37012] Disable pinned thread mode by default

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Invalid
• Affects Version/s: 3.3.0
• Component/s: PySpark
• Assignee: Unassigned
• Reporter: Hyukjin Kwon
• Created: 15/Oct/21 01:52
• Updated: 12/Dec/22 17:51
• Resolved: 23/Dec/21 00:48

Description

Pinned thread mode was enabled by default in Spark 3.2 (SPARK-35303). However, it causes some breaking changes such as SPARK-37004. Maybe we should disable it by default for now.

Issue Links

• is caused by: SPARK-35303 Enable pinned thread mode by default
• links to: [Github] Pull Request #34288 (HyukjinKwon)