[SPARK-42189] Guides for implementing custom data sources & sinks for structured streaming

• Type: Documentation
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.1
• Component/s: Input/Output, Structured Streaming
• Assignee: Unassigned
• Reporter: Kai-Michael Roesner
• Created: 25/Jan/23 16:32
• Updated: 04/Dec/23 09:18

Description

Please create programming guides about how to implement custom data sources and sinks for structured streaming (or include them in the "Structured Streaming" guide). The data source part has been asked on SOF but the accepted answer is not comprehensive and a bit dated (referring to old API versions).