[SPARK-41369] Refactor connect directory structure

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.2, 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Connect
• Assignee: Hyukjin Kwon
• Reporter: Venkata Sai Akhil Gudesa
• Created: 02/Dec/22 14:58
• Updated: 09/Dec/22 07:42
• Resolved: 07/Dec/22 02:51

Description

Currently, `spark/connector/connect/` is a single module that contains both the "server"/service as well as the protobuf definitions.

However, this module can be split into multiple modules - "server" and "common". This brings the advantage of separating out the protobuf generation from the core "server" module for efficient reuse.

Issue Links

• links to: [Github] Pull Request #38889 (vicennial)
• links to: [Github] Pull Request #38889 (vicennial)
• links to: [Github] Pull Request #38927 (zhengruifeng)
• links to: [Github] Pull Request #38944 (hvanhovell)
• links to: [Github] Pull Request #38953 (hvanhovell)
• links to: [Github] Pull Request #38957 (amaliujia)
• links to: [Github] Pull Request #38967 (hvanhovell)
• links to: [Github] Pull Request #38967 (hvanhovell)