[SPARK-45856] Move ArtifactManager from Spark Connect into SparkSession (sql/core)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect, SQL
• Labels: pull-request-available
• Assignee: Venkata Sai Akhil Gudesa
• Reporter: Venkata Sai Akhil Gudesa
• Created: 09/Nov/23 15:47
• Updated: 13/Dec/23 11:38
• Resolved: 21/Nov/23 01:39

Description

The `ArtifactManager` that currently lies in the connect package can be moved into the wider sql/core package (e.g SparkSession) to expand the scope. This is possible because the `ArtifactManager` is tied solely to the `SparkSession#sessionUUID` and hence can be cleanly detached from Spark Connect and be made generally available.

Issue Links

• links to: GitHub Pull Request #43735