[HUDI-7108] Ensure schema is refreshed for every batch when using KafkaAvroSchemaDeserializer

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.1
• Labels: pull-request-available
• Assignee: Rajesh Mahindra
• Reporter: Rajesh Mahindra
• Created: 16/Nov/23 09:49
• Updated: 30/Nov/23 15:24
• Resolved: 30/Nov/23 15:24

Description

In Kafka AVRO source, the schema config for KafkaAvroSchemaDeserializer is only set during constructor and not refreshed for every batch. In Deltastreamer cont. mode, this creates an issue when schema evolves for the kafka messages.

Issue Links

• links to: GitHub Pull Request #10118