[SPARK-47862] Connect generated proots can't be pickled

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.1
• Fix Version/s: 4.0.0
• Component/s: Connect
• Labels: pull-request-available
• Assignee: Martin Grund
• Reporter: Martin Grund
• Created: 15/Apr/24 21:14
• Updated: 16/Apr/24 04:10
• Resolved: 16/Apr/24 04:10

Description

When Spark Connect generates the protobuf files, they're manually adjusted and moved to the right folder. However, we did not fix the package for the descriptor. This breaks serializing them to proto.

Issue Links

• links to: GitHub Pull Request #46068