[GOBBLIN-757] Add support for decorating Avro records with additional fields

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.15.0
• Component/s: gobblin-codecs
• Assignee: Shirshanka Das
• Reporter: Shirshanka Das
• Created: 25/Apr/19 03:54
• Updated: 03/Aug/20 19:24
• Resolved: 03/Aug/20 19:20

Description

Pipeline constructs (e.g. converters) often need to attach additional data to a record as it is being processed.

A simple use-case could be attaching record-level "lineage" metadata from the source system such as the host, the source cluster, the identifier for this record in the source system etc. 

We propose adding utility functions to make these sorts of transformations easy to do on Avro Generic Records. 

 

 

Issue Links

• links to: GitHub Pull Request #2621