[NIFI-8404] Support "Rollback on Failure" for PublishKafka(Record) processors

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: Extensions
• Assignee: Mark Payne
• Reporter: Mark Payne
• Created: 08/Apr/21 14:24
• Updated: 09/Apr/21 16:02
• Resolved: 08/Apr/21 15:51

Description

When the PublishKafka(Record) processors encounter a failure, they route the FlowFiles to the 'failure' relationship. That's usually what we want. But in some cases, we want to be able to rollback on failure. This goes hand-in-hand with the recent feature that was added to allow static assignment of Kafka Partitions to NiFi nodes. That feature ensures that even in a NiFi cluster, we won't have data out-of-order (assuming proper configuration) by sending data from the same partition to multiple NiFi nodes.

Issue Links

• is related to: NIFI-8412 Use proper log messages in PublishKafka(Record) processors in case of "Rollback on Failure"
• links to: GitHub Pull Request #4982