[SPARK-28211] Shuffle Storage API: Driver Lifecycle

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Shuffle, Spark Core
• Assignee: Yifei Huang
• Reporter: Matt Cheah
• Created: 28/Jun/19 18:04
• Updated: 17/May/20 18:30
• Resolved: 15/Oct/19 17:28

Description

As part of the shuffle storage API, allow users to hook in application-wide startup and shutdown methods. This can do things like create tables in the shuffle storage database, or register / unregister against file servers.

Issue Links

• links to: GitHub Pull Request #25823