[HUDI-1226] ComplexKeyGenerator doesnt work for non partitioned tables

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Labels: pull-request-available
• Assignee: satish
• Reporter: satish
• Created: 25/Aug/20 20:32
• Updated: 26/Jan/21 00:20
• Resolved: 26/Jan/21 00:20

Description

1) If we pass empty string(-hoodie-conf hoodie.datasource.write.partitionpath.field=), generator returns 'default' as partitionpath
2) if we pass delimiter alone (-hoodie-conf hoodie.datasource.write.partitionpath.field=,), it throws
java.lang.StringIndexOutOfBoundsException: String index out of range: -1

at java.lang.AbstractStringBuilder.deleteCharAt(AbstractStringBuilder.java:824)
at java.lang.StringBuilder.deleteCharAt(StringBuilder.java:253)
at org.apache.hudi.keygen.KeyGenUtils.getRecordPartitionPath(KeyGenUtils.java:80)
at org.apache.hudi.keygen.ComplexKeyGenerator.getPartitionPath(ComplexKeyGenerator.java:52)
at org.apache.hudi.keygen.BuiltinKeyGenerator.getKey(BuiltinKeyGenerator.java:75)

Issue Links

• is duplicated by: HUDI-1053 Make ComplexKeyGenerator also support non partitioned Hudi dataset
• links to: GitHub Pull Request #2037