[BEAM-1636] UnboundedDataset action() does not materialize RDD

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: runner-spark
• Assignee: Aviem Zur
• Reporter: Aviem Zur
• Created: 07/Mar/17 12:42
• Updated: 16/May/20 13:56
• Resolved: 07/Mar/17 14:28

Description

UnboundedDataset#action does not materialize DStream since it uses register. Instead use foreachRDD...foreach which is an action, which will materialize the RDDs of the DStream.
The reason it worked until now was because there was also a call to cache() before it.

Issue Links

• links to: GitHub Pull Request #2180