[SPARK-15933] Refactor reader-writer interface for streaming DFs to use DataStreamReader/Writer

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Structured Streaming
• Target Version/s: 2.0.0
• Assignee: Tathagata Das
• Reporter: Tathagata Das
• Created: 13/Jun/16 23:34
• Updated: 01/Nov/16 22:15
• Resolved: 15/Jun/16 00:59

Description

Currently, the DataFrameReader/Writer has method that are needed for streaming and non-streaming DFs. This is quite awkward because each method in them through runtime exception for one case or the other. So rather having half the methods throw runtime exceptions, its just better to have a different reader/writer API for streams.

Issue Links

• links to: [Github] Pull Request #13653 (tdas)