[STORM-1326] Evaluate/port JStorm message processing

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: storm-core
• Labels: jstorm-merger
• Assignee: Basti Liu
• Reporter: Robert Joseph Evans
• Created: 23/Nov/15 20:28
• Updated: 25/Nov/15 04:17

Description

Storm:
Deserialization happens on the netty thread

Serialization happens after the send queue when batching is happening.

JStorm:
Add receiving and transferring queue/thread for each task to make deserialization and serialization asynchronously
Remove receiving and transferring thread on worker level to avoid unnecessary locks and to shorten the message processing phase

The two sound equivalent now, but we should talk to see if there are other optimizations needed.

Issue Links

• is part of: STORM-1319 Port JStorm features to storm
• mentioned in: Page Loading...