[SPARK-38115] No spark conf to control the path of _temporary when writing to target filesystem

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.4.8, 3.2.1
• Component/s: Spark Core
• Labels: spark spark-conf spark-sql spark-submit
• Flags: Patch, Important

Language

spark

• Assignee: Unassigned
• Reporter: kk
• Created: 04/Feb/22 22:05
• Updated: 12/Dec/22 18:10

Description

No default spark conf or param to control the '_temporary' path when writing to filesystem.