[HUDI-7201] reconcileSchemaRequirements returns empty schema if the incoming data is empty

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: spark, spark-sql
• Labels: pull-request-available
• Assignee: Jonathan Vexler
• Reporter: Jonathan Vexler
• Created: 08/Dec/23 18:15
• Updated: 11/Dec/23 15:23
• Resolved: 11/Dec/23 15:23

Description

if (sourceSchema.getType() == Schema.Type.NULL || sourceSchema.getFields().isEmpty() || targetSchema.getFields().isEmpty()) {
  return sourceSchema;
} 

This will allow illegal schema evolutions if the previous commit was empty

Issue Links

• links to: GitHub Pull Request #10288