[SAMZA-1645] A few issues found by BEAM stress test

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.1
• Assignee: Xinyu Liu
• Reporter: Xinyu Liu
• Created: 11/Apr/18 00:59
• Updated: 30/Apr/18 17:01
• Resolved: 30/Apr/18 17:01

Description

1. Setting high priority on intermediate streams caused starvation on certain tasks. Due to the intermediate message kept coming, the input streams are not consumed and watermark messages are not generated, which makes downstream accumulates large state and makes processing slower thus make starvation worse.
2. Watermark broadcast needs to check whether the watermark is advanced.

Issue Links

• links to: GitHub Pull Request #469