[SPARK-16407] Allow users to supply custom StreamSinkProviders

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: DStreams
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Holden Karau
• Created: 07/Jul/16 03:50
• Updated: 21/May/19 04:33
• Resolved: 21/May/19 04:33

Description

The current DataStreamWriter allows users to specify a class name as format, however it could be easier for people to directly pass in a specific provider instance - e.g. for user equivalent of ForeachSink or other sink with non-string parameters.

Issue Links

• relates to: SPARK-16424 Add support for Structured Streaming to the ML Pipeline API
• links to: [Github] Pull Request #14691 (holdenk)