[IMPALA-5151] Adding partition on impala over a table with old metadata

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Epic Color: ghx-label-3
• Assignee: Unassigned
• Reporter: Daniel Goldszmit
• Created: 03/Apr/17 13:53
• Updated: 21/Dec/20 19:07
• Resolved: 21/Dec/20 19:07

Description

1) connect on beeline and execute:
CREATE TABLE test(id int,description string) PARTITIONED BY (year string) ;
2) connect on Impala and execute:
invalidate metadata test;
desc test;
3) from beeline change the table structure:
ALTER TABLE test ADD COLUMNS (missing_col string );
4) At this point Impala holds a old metadata, an impala does not know about the new column "missing_col" when execute the SQL statement:

alter table add partition (year='2017');

Impala will change the table structure for the table test, basically reverting any changes that have been made on the table to the point from impala last invalidate metadata.
5) from beeline session executing the command:
desc test
the new field "missing_col" no longer will appear.

Issue Links

• relates to: IMPALA-7954 Support automatic invalidates using metastore notification events