[SPARK-5746] Check invalid cases for the write path of data source API

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0
• Component/s: SQL
• Target Version/s: 1.3.0
• Assignee: Cheng Lian
• Reporter: Cheng Lian
• Created: 11/Feb/15 20:08
• Updated: 16/Feb/15 23:52
• Resolved: 16/Feb/15 23:52

Description

Right now, with the newly introduced write support of data source API, JSONRelation and ParquetRelation2 both delete data first when the save mode is overwrite (here) and this behavior introduces issues when the destination table is an input table of the query. For example

INSERT OVERWRITE t SELECT * FROM t

We need to add an analysis rule to check cases that are invalid for the write path of data source API.

Issue Links

• is related to: SPARK-5821 JSONRelation and ParquetRelation2 should check if delete is successful for the overwrite operation.
• links to: [Github] Pull Request #4610 (yanbohappy)
• links to: [Github] Pull Request #4617 (yhuai)