[HUDI-1424] Write Type changed to BULK_INSERT when set ENABLE_ROW_WRITER_OPT_KEY=true

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Component/s: spark
• Labels: pull-request-available
• Assignee: pengzhiwei
• Reporter: pengzhiwei
• Created: 30/Nov/20 13:19
• Updated: 21/Jan/21 06:25
• Resolved: 21/Jan/21 06:25

Description

I write data to hudi with UPSERT mode, when set ENABLE_ROW_WRITER_OPT_KEY=true, the write type will change to BULK_INSERT. This can be very confusing to users.

This was caused by the  if-test condition  in HoodieSparkSqlWriter#write as follow:

There is a lack of judgment on the write type,which make all of the write type change to bulk write.

 

Issue Links

• links to: GitHub Pull Request #2289