[SPARK-29158] Expose SerializableConfiguration for DSv2

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.5, 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Spark Core, SQL
• Assignee: Holden Karau
• Reporter: Holden Karau
• Created: 18/Sep/19 21:23
• Updated: 12/Dec/22 18:10
• Resolved: 20/Sep/19 05:39

Description

Since we use it frequently inside of our own DataSourceV2 implementations (13 times from `

grep -r broadcastedConf ./sql/core/src/ |grep val |wc -l`

) we should expose the SerializableConfiguration for DSv2 dev work

Issue Links

• blocks: SPARK-29163 Provide a mixin to simplify HadoopConf access patterns in DataSource V2
• links to: GitHub Pull Request #25838
• links to: GitHub Pull Request #25867