[MINIFICPP-1990] Transferring FlowFiles in Python Processors

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.0
• Fix Version/s: 0.14.0
• Assignee: Gábor Gyimesi
• Reporter: Kondakov Artem
• Created: 17/Nov/22 07:14
• Updated: 05/Dec/22 12:51
• Resolved: 05/Dec/22 12:51

Description

Hello.
There is a problem with the processing of flow-files in python processors, which are connected using the setting
nifi.python.processor.dir=./minifi-python/

If you need to split one file into several, then you have to create new files in the Python processor and be sure to transfer the original one to REL_FAILURE.
Otherwise, if I do not pass the original file to REL_FAILURE, then the processing result is rolled back and nothing happens

It seems to me that it is necessary to make it possible for Python processors to add various relations, and not just REL_FAILURE REL_SUCCESS.
Or add an additional possible relationship REL_ORIGIN to which you can pass the original file

That. if you look at the metrics for these processors, you see TransferredToFaillure > 0, although the processors processed without errors

Another additional possibility is to add the session.remove (flowfile ) method (as it is done for example in the processor ExecuteSQL). Then it will be possible to exclude incoming files from further processing