[SPARK-35083] Support remote scheduler pool file

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: Spark Core
• Assignee: XiDuo You
• Reporter: XiDuo You
• Created: 15/Apr/21 03:14
• Updated: 20/Aug/21 02:39
• Resolved: 16/Apr/21 07:18

Description

Make `spark.scheduler.allocation.file` suport remote file. When using Spark as a server (e.g. SparkThriftServer), it's hard for user specify a local path as the scheduler pool.

Issue Links

• links to: [Github] Pull Request #32184 (ulysses-you)
• links to: [Github] Pull Request #33785 (Ngone51)
• links to: [Github] Pull Request #33789 (gengliangwang)
• links to: [Github] Pull Request #33789 (gengliangwang)
• links to: [Github] Pull Request #33794 (ulysses-you)