[NIFI-751] Add Processor To Convert Avro Formats

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: 0.3.0
• Component/s: Extensions
• Assignee: Joe Witt
• Reporter: Alan Jackoway
• Created: 07/Jul/15 21:23
• Updated: 14/Dec/16 08:16
• Resolved: 17/Aug/15 04:49

Description

When working with data from external sources, such as complex WSDL, I frequently wind up with complex nested data that is difficult to work with even when converted to Avro format. Specifically, I often have two needs:

• Converting types of data, usually from string to long, double, etc. when APIs give only string data back.
• Flattening data by taking fields out of nested records and putting them on the top level of the Avro file.

Unfortunately the Kite JSONToAvro processor only supports exact conversions from JSON to a matching Avro schema and will not do data transformations of this type. Proposed processor to come.

Discussed this with rdblue, so tagging him here as I don't have permission to set a CC for some reason.

Issue Links

• links to: GitHub Pull Request #70