Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
Description
The feedback brokers identify a single pair of producer / consumer with a SubtaskFeedbackKey, which is uniquely identified within a job by only the subtask index.
This can potentially become an issue in job restart scenarios, since the feedback brokers are static fields, and are durable across non-TM failure job restarts.
Currently it is not a problem because we do clear broker channels on close, but adding an extra execution attempt ID into the SubtaskFeedbackKey can make things safer.
Attachments
Issue Links
- links to