[SPARK-36377] Fix documentation in spark-env.sh.template

• Type: Documentation
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.2
• Fix Version/s: 3.3.0
• Component/s: Documentation, Spark Submit
• Assignee: Yuto Akutsu
• Reporter: Yuto Akutsu
• Created: 02/Aug/21 03:22
• Updated: 12/Dec/22 18:11
• Resolved: 10/Aug/21 02:06

Description

Some options in the "Options read in YARN client/cluster mode" section in spark-env.sh.template is read by other modes too (e.g. SPARK_CONF_DIR, SPARK_EXECUTOR_CORES, etc.), so we should re-document it to help users distinguish what's only read by YARN mode from what's not.

Issue Links

• links to: [Github] Pull Request #33604 (yutoacts)
• links to: [Github] Pull Request #33604 (yutoacts)