[HUDI-5574] Support auto record key generation with Spark SQL

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Component/s: writer-core
• Labels: release-0.14.0-blocker
• Story Points: 2
• Epic Link: Primary Key-less Model
• Assignee: sivabalan narayanan
• Reporter: Lokesh Jain
• Created: 18/Jan/23 07:48
• Updated: 23/May/23 05:29
• Resolved: 09/May/23 12:35

Description

HUDI-2681 adds support for auto record key generation with spark dataframes. This Jira aims to add support for the same with spark sql.

One of the changes required here as pointed out by kazdy is that SQL_INSERT_MODE would need to be handled here. In this case if SQL_INSERT_MODE mode is set to strict, the insert should fail.

cc shivnarayan 

Essentially, based on this patch (https://github.com/apache/hudi/pull/7681),
we want to ensure spark-sql writes also supports auto generation of record keys.