[NIFI-8273] Adding Scripted Record processors

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Extensions
• Assignee: Simon Bence
• Reporter: Simon Bence
• Created: 01/Mar/21 13:46
• Updated: 20/Jun/22 18:00
• Resolved: 23/Sep/21 13:16

Description

The ScriptedTransformRecord was recently added which we can use as a starting point for a few additional scripted processors for common tasks. These might be:

• ScriptedPartitionRecord. Given a Record, would return the name of a 'partition' to send to. Two Records from an incoming FlowFile will go to the same outbound FlowFile if they belong to the same Partition.
• ScriptedValidateRecord. Given a record, return true or false to indicate whether it should go to 'valid' or 'invalid'. This is less powerful and can easily be encapsulated within the previous one. However, it might make sense to provide it anyway, just because if you want to validate a record, it's more obvious that this is the right processor.
• ScriptedFilterRecord. Given a Record, returns true to keep the Record, false to drop the Record. Can already be done using the ScriptedTransformRecord by returning null. But it does make sense to offer this anyway from a user experience point of view

All the above processors are very similar in functionalities and encapsulate each other. However the idea is to provide a set of processors that are obvious to use even if there is one that could answer all the needs by tweaking the configuration.

Issue Links

• is duplicated by: NIFI-7940 Create a ScriptedPartitionRecord
• links to: GitHub Pull Request #4948