[SPARK-32896] Add DataStreamWriter.toTable API

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Structured Streaming
• Assignee: Jungtaek Lim
• Reporter: Jungtaek Lim
• Created: 16/Sep/20 02:44
• Updated: 03/Dec/20 01:38
• Resolved: 09/Oct/20 10:02

Description

For now, there's no way to write to the table (especially catalog table) even the table is capable to handle streaming write.

We can add DataStreamWriter. table toTable API to let end users specify table as provider, and let streaming query write into the table. That is just to specify the table, and the overall usage of DataStreamWriter isn't changed.

Issue Links

• links to: [Github] Pull Request #29767 (HeartSaVioR)
• links to: [Github] Pull Request #30571 (xuanyuanking)
• links to: [Github] Pull Request #30571 (xuanyuanking)