[SPARK-36335] Document local-cluster mode option in developper tools doc

• Type: Documentation
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.2
• Component/s: Documentation
• Assignee: Unassigned
• Reporter: Yuto Akutsu
• Created: 29/Jul/21 02:05
• Updated: 29/Jul/21 07:11

Description

Local-cluster mode is often used by developers but is not documented on any testing related docs. I think It should be documented on developer tools doc (https://spark.apache.org/developer-tools.html).

Also this mode is slightly mentioned on a user reference doc though it is only for unit tests, so we should remove it to avoid confusing people.

 

Related links:

https://issues.apache.org/jira/browse/SPARK-595

https://github.com/apache/spark/pull/33537

 

Issue Links

• links to: [Github] Pull Request #33568 (yutoacts)