[NIFI-2850] Provide ability for a FlowFile to be migrated from one Process Session to another

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Core Framework
• Assignee: Joe Witt
• Reporter: Mark Payne
• Created: 01/Oct/16 00:00
• Updated: 09/Nov/16 21:26
• Resolved: 09/Nov/16 21:26

Description

Currently, the MergeContent processor creates a separate ProcessSession for each FlowFile that it pulls. This is done so that we can ensure that we can commit all Process Sessions when a bin is full. Unfortunately, this means that MergeContent is required to call ProcessSession.get() many times, which adds a lot of contention on the FlowFile Queue. If we allow FlowFiles to be migrated from 1 session to another, we can have a session per bin, and then use ProcessSession.get(100) to greatly reduce lock contention. This will likely have benefits in other processors as well.

Issue Links

• links to: GitHub Pull Request #1115