[SPARK-28573] Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: YE
• Reporter: YE
• Created: 31/Jul/19 03:30
• Updated: 03/Sep/19 05:42
• Resolved: 03/Sep/19 05:42

Description

Currently we don't translate InsertInto(HiveTableRelation) to DataSource insertion when partitioned table is involved, the reason is that, quote from the comments:

// Inserting into partitioned table is not supported in Parquet/Orc data source (yet).

 

which doesn't hold any more. Since datasource table dynamic partition insert now supports 

dynamic mode (SPARK-20236). I think it's worthy to translate InsertIntoTable(HiveTableRelation) to datasource table.

Issue Links

• links to: GitHub Pull Request #25306