[NIFI-4165] Update NiFi FlowFile Repository Toolkit to provide ability to remove FlowFiles whose content is missing

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Tools and Build
• Assignee: Mark Payne
• Reporter: Mark Payne
• Created: 07/Jul/17 16:53
• Updated: 27/May/21 00:13

Description

The FlowFile Repo toolkit has the ability to address issues with flowfile repo corruption due to sudden power loss. Another problem that has been known to occur is if content goes missing from the content repository for whatever reason (say some process deletes some of the files) then the FlowFile Repo can contain a lot of FlowFiles whose content is missing. This causes a lot of problems with stack traces being dumped to logs and the flow taking a really long time to get back to normal. We should update the toolkit to provide a mechanism for pointing to a FlowFile Repo and Content Repo, then writing out a new FlowFile Repo that removes any FlowFile whose content is missing.

Issue Links

• links to: GitHub Pull Request #2502
• links to: GitHub Pull Request #2502