[HUDI-5684] Fix CTAS to make combine-on-insert configurable

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Labels: pull-request-available
• Story Points: 1
• Epic Link: Hudi Spark Datasource
• Assignee: Alexey Kudinkin
• Reporter: Alexey Kudinkin
• Created: 02/Feb/23 05:43
• Updated: 07/Feb/23 23:43
• Resolved: 02/Feb/23 12:21

Description

Currently, CTAS sets `COMBINE_ON_INSERT` config value whenever target table has pre-combine key specified.

However, it's currently done in a way that doesn't allow it to be overridden by user-provided configuration. We need to address that

Issue Links

• fixes: HUDI-5679 Deduplication in row-writing bulk-insert ends up w/ OOMs
• links to: GitHub Pull Request #7813