[BEAM-1512] Optimize leaf transforms materialization

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: runner-spark
• Assignee: Aviem Zur
• Reporter: Aviem Zur
• Created: 19/Feb/17 17:20
• Updated: 16/May/20 13:39
• Resolved: 20/Feb/17 10:26

Description

Optimize leaf materialization in EvaluationContext Use register for DStream leaves and an empty foreachPartition for other leaves instead of the current count() which adds overhead.

Issue Links

• links to: GitHub Pull Request #2046