[NIFI-6925] JoltTransformRecord, PutESHttpRecord, PutHive3Streaming fail with various RecordReaders

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: Extensions
• Assignee: Matt Burgess
• Reporter: Matt Burgess
• Created: 03/Dec/19 19:29
• Updated: 08/May/20 19:27
• Resolved: 17/Dec/19 22:00

Description

When using JoltTransformRecord with readers such as AvroReader or CSVReader, an error occurs when trying to transfer the original input flowfile to the "original" relationship. The error indicates that it is reading from multiple callbacks or that the input stream is still open. It happens to work with JsonTreeReader because the underlying JSON parser closes the stream when no more records are available.

This is a result of not explicitly closing the input stream before trying to transfer the input flow file. It was not caught in the unit tests because MockProcessSession doesn't keep track of the open reader count, so that should be fixed as well. Fixing MockProcessSession will cause TestJoltTransformRecord to fail before the fix for this case is applied.

Issue Links

• links to: GitHub Pull Request #3913