[BEAM-8403] Race condition in request id generation of GrpcStateRequestHandler

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.17.0
• Component/s: sdk-py-harness
• Assignee: Maximilian Michels
• Reporter: Maximilian Michels
• Created: 15/Oct/19 09:57
• Updated: 16/May/20 14:12
• Resolved: 16/Oct/19 09:35

Description

There is a race condition in GrpcStateRequestHandler which surfaced after the recent changes to process append/clear state request asynchronously. The race condition can occur if multiple Runner workers process a transform with state requests with the same SDK Harness. For example, this setup occurs with Flink when a TaskManager has multiple task slots and two or more of those slots process the same stateful stage against an SDK Harness.

CC robertwb

Issue Links

• links to: GitHub Pull Request #9800