[NIFI-5005] MergeRecord processor ignoring writer schema for JsonRecordSetWriter output

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.17.0
• Component/s: Extensions
• Assignee: Matt Burgess
• Reporter: Nick Pettyjohn
• Created: 22/Mar/18 21:03
• Updated: 27/Jun/22 19:57
• Resolved: 27/Jun/22 19:57

Description

Issue noticed when using a MergeRecord processor with a Record Reader of CSVReader and a Record Writer of JsonRecordSetWriter.

The CSVReader is configured with a Schema Access Strategy of "Use String Fields From Header". The JsonRecordSetWriter is given an Avro schema in the Schema Text property that contains a mix of string, double, and long value types.

Running sample csv data through the MergeRecord processor produces JSON in which all values are quoted, despite the Avro schema specifying otherwise. However, when using the ConvertRecord processor with the same Reader/Writer config, the output JSON records use the typing given in the avro schema, keeping long and float values unquoted.

The attached template, with corresponding avro schema and sample input csv file will demonstrate the issue.

Issue Links

• links to: GitHub Pull Request #6141