[STORM-1327] Evaluate/Port JStorm tuple batching

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: storm-core
• Labels: jstorm-merger
• Assignee: Basti Liu
• Reporter: Robert Joseph Evans
• Created: 23/Nov/15 20:29
• Updated: 25/Nov/15 04:17

Description

Storm:
Batching in DisruptorQueue

JStorm:
Do batch before sending tuple to transfer queue and support for adjusting the batch size dynamically according to samples of actual batch size sent out for past intervals.

Should evaluate both implementations, and see which is better for performance, and possible if we can/should move some of the dynamic batching logic into disruptor.

Issue Links

• is part of: STORM-1319 Port JStorm features to storm
• mentioned in: Page Loading...