[BEAM-12475] When bundle processors are re-used, do not respond to splits for previous bundles.

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Affects Version/s: 2.30.0
• Fix Version/s: 2.31.0
• Component/s: java-fn-execution
• Assignee: Robert Bradshaw
• Reporter: Robert Bradshaw
• Created: 10/Jun/21 20:58
• Updated: 22/Jun/21 17:10
• Resolved: 16/Jun/21 18:32

Description

The error manifests in the following way:

(thread1) Start processing bundle A
(thread2) Receive request to split for bundle A
(thread1) Finish bundle A
(thread1) Reset bundle processor
(thread1) Start processing bundle B
(thread2) Process split for bundle A on bundle B

Runners, such as Dataflow, that ensure the self-reported number of elements processed by the SDK is equal to the number they expected to be processed (taking into account the runner's understanding of all splits) can detect this and reject A and B as invalid, but we should fix this race condition.

Issue Links

• links to: GitHub Pull Request #14991
• links to: GitHub Pull Request #15042
• links to: GitHub Pull Request #15055
• links to: GitHub Pull Request #15059