[SPARK-38606] Update document to make a good guide of multiple versions of the Spark Shuffle Service

• Type: Documentation
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0, 3.2.2
• Component/s: Documentation
• Assignee: tonydoen
• Reporter: tonydoen
• Created: 20/Mar/22 10:29
• Updated: 21/Mar/22 18:49
• Resolved: 21/Mar/22 18:49

Description

We have tried to run multiple versions of the Spark Shuffle Service  according https://github.com/apache/spark/blob/master/docs/running-on-yarn.md

but, it wont work. 

Then we solved it by using colon when writing %s.classpath instead of commas.

 

Related discussing is in 

https://issues.apache.org/jira/browse/YARN-4577?focusedCommentId=17493624&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17493624

 

Issue Links

• links to: [Github] Pull Request #35914 (TonyDoen)