[BEAM-10698] SDFs broken for Dataflow runner v2 due to timestamps being out of bound

• Type: Bug
• Status: Resolved
• Priority: P0
• Resolution: Fixed
• Fix Version/s: 2.24.0
• Component/s: cross-language, io-py-kafka, runner-dataflow
• Assignee: Boyuan Zhang
• Reporter: Chamikara Madhusanka Jayalath
• Created: 12/Aug/20 22:51
• Updated: 07/Apr/21 15:25
• Resolved: 07/Apr/21 15:25

Description

Seems like this is a regression introduced by https://github.com/apache/beam/pull/11749

I have a short term fix here: https://github.com/apache/beam/pull/12557

We should either.

(1) Include https://github.com/apache/beam/pull/12557 in the release branch

(2) Find the underlying issue that produces wrong timestamps and do that fix

(3) Revert https://github.com/apache/beam/pull/11749 from the 2.24.0 release branch.

Issue Links

• links to: GitHub Pull Request #12557
• links to: GitHub Pull Request #12561
• links to: GitHub Pull Request #12577
• links to: GitHub Pull Request #12584
• links to: GitHub Pull Request #12585