[HUDI-728] Support for complex record keys with TimestampBasedKeyGenerator

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: deltastreamer, Usability
• Labels: bug-bash-0.6.0 pull-request-available
• Assignee: Pratyaksh Sharma
• Reporter: Pratyaksh Sharma
• Created: 20/Mar/20 14:00
• Updated: 24/Aug/20 18:28
• Resolved: 24/Aug/20 18:28

Description

We have TimestampBasedKeyGenerator for defining custom partition paths and we have ComplexKeyGenerator for supporting having combination of fields as record key or partition key. 
 
However we do not have support for the case where one wants to have combination of fields as record key along with being able to define custom partition paths. This use case recently came up at my organisation. 
 
How about having CustomTimestampBasedKeyGenerator which supports the above use case? This class can simply extend TimestampBasedKeyGenerator and allow users to have combination of fields as record key.
 
We will try to have the implementation as generic as possible. 

Issue Links

• is depended upon by: HUDI-901 Bug Bash 0.6.0 Tracking Ticket
• links to: GitHub Pull Request #1433
• links to: GitHub Pull Request #1433