[BEAM-13852] KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions

• Type: Bug
• Status: In Progress
• Priority: P1
• Resolution: Unresolved
• Component/s: io-java-kafka
• Assignee: John Casey
• Reporter: John Casey
• Created: 08/Feb/22 14:56
• Updated: 04/Jun/22 23:38

Description

KafkaIO.Read().withDynamicRead() is correctly pulling messages from existing topics, but isn't picking up new topics or partitions when they are created.

Currently, this appears to be an interaction between the timer configuration, and the duration of the operating window, that is causing the problem