[SPARK-25593] JDBC write Impala, `truncate` true option in Overwrite mode for JDBC DataFrameWriter is dropping and creating the table instead of truncating.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.3.2
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: rakesh
• Shepherd: Dongjoon Hyun
• Created: 02/Oct/18 07:30
• Updated: 08/Oct/19 05:43
• Resolved: 08/Oct/19 05:43

Description

Scenario :

Reading data from Impala using jdbc (cloudera jdbc41 driver) and writing to Impala with command write.mode(SaveMode.Overwrite).option("truncate", true)

Observed:
It's dropping and trying to create a new table. failing with exception

CAUSED BY: Exception: Syntax error
), Query: CREATE TABLE jdbc_spark.persons_write_200 ("personid" INTEGER , "lastname" TEXT , "firstname" TEXT , "address"
TEXT , "city" TEXT ).

Expected :
It should only truncate the table.

Note : With SaveMode.Append it's working absolutely fine.

relates to SPARK-16463