[BEAM-7820] Add hot key detection to Dataflow Runner

• Type: New Feature
• Status: Triage Needed
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.15.0, 2.16.0
• Component/s: runner-dataflow
• Assignee: Sam Rohde
• Reporter: Sam Rohde
• Created: 25/Jul/19 17:36
• Updated: 13/Apr/23 10:56
• Resolved: 13/Aug/19 21:11

Description

This tracks adding hot key detection in the Dataflow Runner. 

There are times when a user's pipeline spuriously slows down due to hot keys. During these times, users are unable to see under the hood at what the pipeline is doing. This adds hot key detection to show the user when their pipeline has a hot key.

Issue Links

• links to: GitHub Pull Request #9155
• links to: GitHub Pull Request #9186
• links to: GitHub Pull Request #9270