[MINIFICPP-1062] Improve FlowFile repository performance by leveraging batching

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.6.0
• Fix Version/s: 0.7.0
• Assignee: Arpad Boda
• Reporter: Arpad Boda
• Created: 10/Oct/19 20:22
• Updated: 12/Nov/19 16:06
• Resolved: 12/Nov/19 16:06

Description

The current ProcessSession mechanism handles every record in a single transaction fashion even if there is a batch of records being updated. Since the underlying mechanism is Rocksdb and it supports batching into a single transaction we should leverage that. This will drive baseline performance on modest hardware up significantly.

Right now under default settings we see 100FF/s on a modest notebook and we can do much better.

Issue Links

• links to: GitHub Pull Request #664