[NEMO-394] Exchange data via shared memory when two tasks are in the same Executor in streaming

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.4
• Labels: pull-request-available streaming
• Assignee: Unassigned
• Reporter: Tae-Geon Um
• Created: 13/Jun/19 00:55
• Updated: 04/Sep/22 12:49
• Resolved: 04/Sep/22 12:49

Description

Nemo streaming runtime exchanges data via netty channel, although two tasks are in the same Executor. This causes unnecessary (de)serialization of data and network overhead. 

We should optimize the data transfer via shared memory (e.g., queue) when tasks are in the same Executor.

Issue Links

• links to: GitHub Pull Request #304