[DRILL-3938] Hive: Failure reading from a partition when a new column is added to the table after the partition creation

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 1.4.0
• Component/s: Storage - Hive
• Assignee: Venki Korukanti
• Reporter: Venki Korukanti
• Reviewer: Rahul Kumar Challapalli
• Created: 15/Oct/15 15:01
• Updated: 06/Jan/16 23:31
• Resolved: 01/Dec/15 22:04

Description

Repro:

From Hive:

CREATE TABLE kv(key INT, value STRING);
LOAD DATA LOCAL INPATH '/Users/hadoop/apache-repos/hive-install/apache-hive-1.0.0-bin/examples/files/kv1.txt' INTO TABLE kv;
CREATE TABLE kv_p(key INT, value STRING, part1 STRING);
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.exec.max.dynamic.partitions=10000;
set hive.exec.max.dynamic.partitions.pernode=10000;
INSERT INTO TABLE kv_p PARTITION (part1) SELECT key, value, value as s FROM kv;

ALTER TABLE kv_p ADD COLUMNS (newcol STRING);

From Drill:

USE hive;
DESCRIBE kv_p;
SELECT newcol FROM kv_p;
throws column 'newcol' not found error in HiveRecordReader while selecting only the projected columns.