[SPARK-27492] GPU scheduling - High level user documentation

• Type: Story
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Documentation
• Epic Link: GPU-aware Scheduling
• Assignee: Thomas Graves
• Reporter: Thomas Graves
• Created: 17/Apr/19 16:55
• Updated: 12/Dec/22 18:11
• Resolved: 11/Sep/19 13:23

Description

For the SPIP - Accelerator-aware task scheduling for Spark, https://issues.apache.org/jira/browse/SPARK-24615 Add some high level user documentation about how this feature works together and point to things like the example discovery script, etc.

 

• make sure to document the discovery script and what permissions are needed and any security implications
• Document standalone - local-cluster mode limitation of only a single resource file or discovery script so you have to have coordination on for it to work right.

Issue Links

• links to: GitHub Pull Request #25698
• links to: GitHub Pull Request #26047