[NIFI-8659] JoltTransformRecord should support transformation of one record to multiple output records

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Assignee: Matt Burgess
• Reporter: Matt Burgess
• Created: 04/Jun/21 16:57
• Updated: 07/Jun/21 19:31
• Resolved: 07/Jun/21 19:31

Description

Currently the JOLT transformation in JoltTransformRecord is applied to each record individually, and a single record is expected and written out. However there are some cases where multiple output records are desired for each input record, such as "hoisting" a nested array of records up to the top-level (without a top-level key which would make it a single record). For example:

Input record:
{"x": [

{"a": 1, "b":2}

,

{"a": 3, "b": 4}

,

{"a": 5, "b": 6}

]}

Desired output (3 records):
[

{"a": 1, "b":2}

,

{"a": 3, "b": 4}

,

{"a": 5, "b": 6}

]

This would currently still require the schema of the array elements to be identical, as the first transformed record's schema will be used to write all the output records.

Issue Links

• links to: GitHub Pull Request #5126