[SPARK-13699] Spark SQL drops the table in "overwrite" mode while writing into table

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.6.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Dhaval Modi
• Created: 05/Mar/16 14:16
• Updated: 12/Dec/22 18:10
• Resolved: 08/Oct/16 13:39

Description

Hi,

While writing the dataframe to HIVE table with "SaveMode.Overwrite" option.

E.g.
tgtFinal.write.mode(SaveMode.Overwrite).saveAsTable("tgt_table")

sqlContext drop the table instead of truncating.

This is causing error while overwriting.

Adding stacktrace & commands to reproduce the issue,

Thanks & Regards,
Dhaval

Issue Links

• duplicates: SPARK-16410 DataFrameWriter's jdbc method drops table in overwrite mode