[SPARK-25528] data source V2 API refactoring (batch read)

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Target Version/s: 3.0.0
• Assignee: Wenchen Fan
• Reporter: Wenchen Fan
• Created: 25/Sep/18 15:34
• Updated: 22/Mar/19 01:42
• Resolved: 30/Nov/18 08:03

Description

refactor the read side API according to this abstraction

batch: catalog -> table -> scan
streaming: catalog -> table -> stream -> scan

Issue Links

• supercedes: SPARK-23398 DataSourceV2 should provide a way to get a source's schema.
• links to: [Github] Pull Request #22547 (cloud-fan)
• links to: [Github] Pull Request #22547 (cloud-fan)
• links to: [Github] Pull Request #22547 (cloud-fan)
• links to: [Github] Pull Request #23086 (cloud-fan)
• links to: GitHub Pull Request #23086