[NIFI-752] Swapping and out of FlowFiles should be driven by FlowFileQueue, rather than in background thread

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.4.0
• Component/s: Core Framework
• Assignee: Unassigned
• Reporter: Mark Payne
• Created: 08/Jul/15 00:25
• Updated: 04/Nov/15 14:57
• Resolved: 14/Oct/15 15:59

Description

As-is, if a huge number of FlowFiles are generated quickly enough, the JVM heap can fill before FlowFiles are swapped in. Conversely, if FlowFiles are swapped out, are NiFi is able to work those FlowFiles off, it ends up pausing, waiting for more FlowFiles to be swapped in. If the queue itself has control of this, these issues will both be alleviated.

Issue Links

• duplicates: NIFI-122 FlowFileQueue should block if queue is too full