[HOP-2839] Add support for Apache Avro

• Type: Improvement
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 0.99
• Component/s: API, Plugins
• Labels: pull-request-available
• Assignee: Matt Casters
• Reporter: Matt Casters
• Created: 30/Apr/21 08:06
• Updated: 21/Jun/21 06:47
• Resolved: 21/Jun/21 06:47

Description

See: http://avro.apache.org

Some things we need:

• A way to read from files in Avro format (Avro Input transform)
• A way to write to files in Avro format (Avro Output transform)
• A native "Avro Schema" data type to contain a collection of values
• A way to convert from/to an "Avro Schema" data type to Hop values (An Avro Schema Convert transform)
• A way for existing plugins like Kafka Consumer to output native formats

 

Issue Links

• links to: GitHub Pull Request #831
• links to: GitHub Pull Request #832