[NIFI-6559] FlowFile Repo Journal Recovery Should not Fail if External Overflow Files are Missing

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Core Framework
• Assignee: Peter Wicks
• Reporter: Peter Wicks
• Created: 16/Aug/19 14:31
• Updated: 21/Aug/19 15:11

Description

When NiFi is journaling the FlowFile repository changes to disk it sometimes writes Overflow files if it exceeds a certain memory threshold.

These files are tracked inside of the *.journal files as External File References. If one of these external file references is deleted or lost the entire journal fails to recover.

Instead, I feel this should work more like FlowFile's that lose their queue, or Content in the Content Repository that has lost it's FlowFile.  Log it, and move on.

Issue Links

• links to: GitHub Pull Request #3655