[FLINK-12855] Stagger TumblingProcessingTimeWindow processing to distribute workload

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: API / DataStream
• Labels: pull-request-available
• Assignee: Teng Hu
• Reporter: Teng Hu
• Created: 15/Jun/19 02:59
• Updated: 16/Oct/20 10:54
• Resolved: 12/Jun/20 13:26

Description

Flink natively triggers all panes belonging to same window at the same time. In other words, all panes are aligned and their triggers all fire simultaneously, causing the thundering herd effect.

This new feature provides the option that panes could be staggered across partitioned streams, so that their workloads are distributed.

Attachment: proof of concept working

Issue Links

• links to: GitHub Pull Request #8885
• links to: GitHub Pull Request #12297