[IMPALA-11926] Ignore avro.schema.url if table doesn't have Avro data

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Catalog
• Labels: newbie ramp-up
• Epic Link: avro-metadata-issues
• Epic Color: ghx-label-9
• Assignee: Unassigned
• Reporter: Zoltán Borók-Nagy
• Created: 16/Feb/23 20:33
• Updated: 11/Mar/24 11:52

Description

In local catalog mode we always try to load the Avro schema if the table property 'avro.schema.url' is present:

https://github.com/apache/impala/blob/80fc49abe6c574f8d6bea8bb56ff4917f6281a41/fe/src/main/java/org/apache/impala/catalog/local/LocalFsTable.java#L142

This makes tables unloadable if the value of this table property is invalid. Even if the actual table doesn't have any Avro partitions.

This is a regression from legacy catalog mode where we only tried to load the Avro schema if the table actually had Avro data:

https://github.com/apache/impala/blob/80fc49abe6c574f8d6bea8bb56ff4917f6281a41/fe/src/main/java/org/apache/impala/catalog/HdfsTable.java#L1758