[GOBBLIN-1015] Support ability to write "native" Avro and Protobuf records into the Parquet Writer

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Assignee: Shirshanka Das
• Reporter: Shirshanka Das
• Created: 06/Jan/20 07:59
• Updated: 15/Jan/20 22:26
• Resolved: 15/Jan/20 22:26

Description

The current Parquet Writer requires a conversion to a Parquet Group object before writing data to the Parquet file. 

Since Parquet libraries natively support writing Avro and Protobuf in-mem formats, we should enable that capability in Gobblin as well. 

 

Issue Links

• links to: GitHub Pull Request #2860