[SPARK-40653] Protobuf Support in Structured Streaming

• Type: Epic
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Protobuf, Structured Streaming
• Epic Name: Protobuf Support
• Assignee: Unassigned
• Reporter: Raghu Angadi
• Shepherd: Raghu Angadi
• Created: 04/Oct/22 20:33
• Updated: 05/Dec/23 22:54
• Resolved: 15/Feb/23 19:30

Description

Add support for Protobuf messages in streaming sources. This would be similar to Avro format support. This includes features like schema-registry, Python support, schema evolution, etc.