[GEARPUMP-111] optimize Stream DSL broadcasting chained operations

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: streaming
• Assignee: Manu Zhang
• Reporter: Manu Zhang
• Created: 28/Apr/16 03:53
• Updated: 19/Dec/16 02:18

Description

In Stream DSL, all broadcasting chained operations will be translated to individual tasks.

For example,

val stream = StreamApp.source(source, 1, "source")
stream.filter(fn, "filter A")
stream.filter(fn, "filter B")
stream.filter(fn, "filter C")

This will be translated to 1 SourceTask and 3 FilterTasks although it's possible for them to be done in 1 Task.