[NIFI-7909] ConvertRecord writes invalid data when converting long to int

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.13.0
• Assignee: Matt Burgess
• Reporter: Christophe Monnet
• Created: 09/Oct/20 07:16
• Updated: 12/Oct/20 21:54
• Resolved: 12/Oct/20 21:54

Description

https://apachenifi.slack.com/archives/C0L9UPWJZ/p1602145019023300

I use ConvertRecord to convert from JSON to Avro.
For a field as "int" in the avro schema, if the json payload contains a number that is too big, NiFi does not throw an error but writes "crap" in the avro file. Is that intended?

When using avrotool it throws an exception: org.codehaus.jackson.JsonParseException: Numeric value (2156760545) out of range of int

The ConvertRecord is configured with JsonTreeReader (Infer Schema strategy) and AvroRecordSetWriter (Use 'Schema Text' Property).
So I guess NiFi converts an inferred long to an explicitely specified int?
How can I make NiFi less lenient? I would prefer a failure than wrong data in output.

Workaround: use ValidateRecord.

I'm also wondering if the ConsumeKafkaRecord processors could be affected.

 

Issue Links

• links to: GitHub Pull Request #4596