[NIFI-3649] Parallelize Consumption of Cluster Replication Responses

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: Core Framework
• Assignee: Mark Payne
• Reporter: Mark Payne
• Created: 24/Mar/17 20:21
• Updated: 30/Mar/17 14:33
• Resolved: 30/Mar/17 14:33

Description

Currently, when we replicate a REST API call to all nodes in the cluster, we wait until we get back a Response object for each node. We then go to the Response Mapper and merge those responses into 1 NodeResponse. This merging is done serially, and this is where we actually do the reading of the response. We need to instead do this merging in parallel or buffer responses in parallel and then merge then when done.

Issue Links

• relates to: NIFI-3257 Cluster stability issues during high throughput
• links to: GitHub Pull Request #1612