[IMPALA-10115] Impala should check file schema as well to check full ACIDv2 files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.0.0
• Epic Color: ghx-label-3
• Assignee: Zoltán Borók-Nagy
• Reporter: Zoltán Borók-Nagy
• Created: 28/Aug/20 15:20
• Updated: 02/Sep/20 07:47
• Resolved: 02/Sep/20 07:47

Description

Currently Impala checks file metadata 'hive.acid.version' to decide the full ACID schema.

There are cases when Hive forgets to set this value for full ACID files, e.g. major query-based compactions.

So if 'hive.acid.version' is not present, Impala should still look at the schema elements to be sure about the file format.