[HIVE-18833] Auto Merge fails when "insert into directory as orcfile"

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Target Version/s: 3.0.0
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 01/Mar/18 07:38
• Updated: 22/May/18 23:12
• Resolved: 03/Mar/18 21:00

Description

Here is the reproduction:

set mapreduce.job.reduces=2;
set hive.merge.tezfiles=true;
INSERT OVERWRITE DIRECTORY 'output' stored as orcfile select age, avg(gpa) from student group by age;

Error message: File Merge Stage after Maps completion is considering input as "input format: org.apache.hadoop.mapred.TextInputFormat" instead of "org.apache.hadoop.hive.ql.io.orc.OrcInputFormat"