Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.0.0, 0.7.0
-
None
-
Patch, Important
Description
The ControlRate processor implements a FlowFileFilter that returns the FlowFileFilter.ACCEPT_AND_TERMINATE result if the FlowFile fits with the rate limit, affectively limiting it to one FlowFile per ConrolRate.onTrigger() invocation. This is a significant bottleneck when processing very large quantities of small files making it unlikely to hit the rate limits.
It should allow multiple files, perhaps with a configurable maximum, per ControlRate.onTrigger() invocation by issuing the FlowFileFilter.ACCEPT_AND_CONTINUE result until the limits are reached. In a preliminary test this eliminated the bottleneck.
