Description
The current data source write API heavily depend on SaveMode, which doesn't have a clear semantic, especially when writing to tables.
We should design a new set of write API without SaveMode.
Attachments
Issue Links
- blocks
-
SPARK-25186 Stabilize Data Source V2 API
- In Progress
- is depended upon by
-
SPARK-22386 Data Source V2 improvements
- In Progress
1.
|
DataSourceV2: Add AppendData logical operation | Resolved | Ryan Blue | |
2.
|
DataSourceV2: Add CTAS logical operation | Resolved | Ryan Blue | |
3.
|
DataSourceV2: Add DeleteSupport for delete and overwrite operations | Resolved | Unassigned | |
4.
|
SPIP: Standardize SQL logical plans with DataSourceV2 | Resolved | Unassigned | |
5.
|
DataSourceV2: Add overwrite and dynamic overwrite. | Resolved | Ryan Blue | |
6.
|
DataSourceV2: Add RTAS logical operation | Resolved | Matt Cheah | |
7.
|
DataSourceV2: Add CreateTable logical operation | Resolved | Ryan Blue |