[BEAM-3194] Support annotating that a DoFn requires stable / deterministic input for replay/retry

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.21.0
• Component/s: beam-model, sdk-java-core
• Labels: Done stale-P2
• Assignee: Unassigned
• Reporter: Kenneth Knowles
• Created: 15/Nov/17 13:03
• Updated: 06/Oct/20 21:56
• Resolved: 11/Jun/20 03:51

Description

See the thread: https://lists.apache.org/thread.html/5fd81ce371aeaf642665348f8e6940e308e04275dd7072f380f9f945@%3Cdev.beam.apache.org%3E

We need this in order to have truly cross-runner end-to-end exactly once via replay + idempotence.

Issue Links

• is a parent of: BEAM-4684 Support @RequiresStableInput on Dataflow runner in Java SDK
• is a parent of: BEAM-5358 Support @RequiresStableInput on Spark runner
• is a parent of: BEAM-5362 Support @RequiresStableInput on Samza runner
• is a parent of: BEAM-5363 Java DirectRunner should implement retry and support @RequiresStableInput
• is a parent of: BEAM-5359 Support @RequiresStableInput on Flink runner
• is a parent of: BEAM-5360 Support @RequiresStableInput on Apex runner
• is a parent of: BEAM-5361 Support @RequiresStableInput on Gearpump runner
• links to: GitHub Pull Request #4135
• links to: GitHub Pull Request #6388