[HUDI-7832] Refactor Deltastreamer S3/GCP Events Source to allow adding auxiliary columns from upstream.

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.16.0, 1.0.0
• Component/s: deltastreamer
• Assignee: Balaji Varadarajan
• Reporter: Balaji Varadarajan
• Created: 05/Jun/24 21:40
• Updated: 11/Jun/24 01:31

Description

Background : https://hudi.apache.org/blog/2021/08/23/s3-events-source/

This Jira is to refactor the classes associated with this feature so that we can allow users to extend functionalities such as adding more columns from s3_meta_table to the s3_hudi_table.