Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.1.2, 3.2.0, 3.3.0
-
None
-
None
Description
Improve InsertIntoHadoopFsRelation file commit logic
Attachments
1.
|
dynamicPartitionOverwrite can direct rename to targetPath instead of partition path one by one |
|
In Progress | Unassigned |
2.
|
Connot insert overwite different partition with same table |
|
In Progress | Unassigned |
3.
|
Optimized FileOutputCommitter with StagingDir |
|
In Progress | Unassigned |
4.
|
Make spark stagingDir can be congfigurable |
|
In Progress | Unassigned |
5.
|
Add new SQLFileCommitProtocol |
|
Resolved | Unassigned |
6.
|
DDLUtils.verifyNotReadPath should check target is subDir |
|
In Progress | Unassigned |