[HUDI-2538] Persist configs to hoodie.properties on the first write

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: writer-core
• Labels: pull-request-available
• Assignee: Yann Byron
• Reporter: Yann Byron
• Created: 09/Oct/21 07:36
• Updated: 24/Feb/22 06:50
• Resolved: 03/Nov/21 10:54

Description

Some configs, like `keygenerator.class`, `hive_style_partitioning`, `partitionpath.urlencode` should be persisted to hoodie.properties when write data in the first time. Otherwise, some inconsistent behavior will happen. And the other write operation do not need to provide these configs. If configs provided don't match the existing configs, raise exceptions. 

And, this is also useful to solve some of the keyGenerator discrepancy issues between DataFrame writer and SQL.

Issue Links

• is related to: HUDI-2390 KeyGenerator discrepancy between DataFrame writer and SQL
• links to: GitHub Pull Request #3823