[HUDI-1128] DeltaStreamer not handling avro records written with older schema

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Component/s: deltastreamer
• Labels: schema-evolution sev:critical user-support-issues
• Assignee: Unassigned
• Reporter: Balaji Varadarajan
• Created: 28/Jul/20 17:49
• Updated: 06/Dec/21 14:21

Description

Context:  https://github.com/apache/hudi/issues/1845

Look at issue 1 of https://github.com/apache/hudi/issues/1845#issuecomment-665180775

When deserializing bytes to avro in OverwriteWithLatestAvroPayload, we are passing latest schema which is failing when the original record was written with older schema