[HIVE-15190] Field names are not preserved in ORC files written with ACID

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.1.0, 2.2.0, 3.1.0, 4.0.0
• Fix Version/s: 3.1.0, 4.0.0-alpha-1
• Assignee: Anthony Hsu
• Reporter: Anthony Hsu
• Created: 13/Nov/16 22:20
• Updated: 21/Oct/22 07:01
• Resolved: 20/Jun/18 17:27

Description

To repro:

drop table if exists orc_nonacid;
drop table if exists orc_acid;

create table orc_nonacid (a int) clustered by (a) into 2 buckets stored as orc;
create table orc_acid (a int) clustered by (a) into 2 buckets stored as orc TBLPROPERTIES('transactional'='true');

insert into table orc_nonacid values(1), (2);
insert into table orc_acid values(1), (2);

Running hive --service orcfiledump <file> on the files created by the insert statements above, you'll see that for orc_nonacid, the files have schema struct<a:int> whereas for orc_acid, the files have schema struct<operation:int,originalTransaction:bigint,bucket:int,rowId:bigint,currentTransaction:bigint,row:struct<_col0:int>>. The last field row should have schema struct<a:int>.

Issue Links

• is related to: HIVE-11092 First delta of an ORC ACID table contains non-descriptive schema
• is related to: HIVE-4243 Fix column names in FileSinkOperator
• links to: Review Board