[HUDI-1653] Add support for composite keys in NonpartitionedKeyGenerator

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Jintao
• Created: 03/Mar/21 20:20
• Updated: 03/Apr/21 18:11
• Resolved: 23/Mar/21 13:53

Description

We are using NonpartitionedKeyGenerator for non-partitioned tables. However, this generator has the limitation that only a single column can be specified as the record key for the table. We have some tables which need a composite key. The ask is to support composite keys for non-partitioned tables.

 

Currently, we can use this config, which is not straight-forward.

hoodie.datasource.write.keygenerator.class: org.apache.hudi.keygen.ComplexKeyGenerator
hoodie.datasource.write.partitionpath.field: ""

 

Can we add support to the NonpartitionedKeyGenerator class to improve usability?

 

Issue Links

• links to: GitHub Pull Request #2627