[SPARK-35419] Enable spark.sql.execution.pyspark.udf.simplifiedTraceback.enabled by default

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: PySpark
• Epic Link: Project Zen
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 17/May/21 04:28
• Updated: 12/Dec/22 18:11
• Resolved: 18/May/21 03:27

Description

SPARK-33407 added the simplification of the stacktraces in Python UDFs which hides unnecessary internal traceback which makes users focus on the exceptions from their own codes.

This JIRA aims to enable it by default.

Issue Links

• links to: [Github] Pull Request #32569 (HyukjinKwon)
• links to: [Github] Pull Request #32569 (HyukjinKwon)