[HIVE-3506] CombineHiveInputFormat doesn't support sub-directory in input path

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Query Processor
• Assignee: Gang Tim Liu
• Reporter: Gang Tim Liu
• Created: 24/Sep/12 22:25
• Updated: 05/Dec/12 07:06

Description

If hive.input.format is org.apache.hadoop.hive.ql.io.CombineHiveInputFormat, the following test will fail with java.io.FileNotFoundException: ... (No such file or directory)

– INCLUDE_HADOOP_MAJOR_VERSIONS(0.23)

CREATE TABLE fact_daily(x int) PARTITIONED BY (ds STRING);
CREATE TABLE fact_tz(x int) PARTITIONED BY (ds STRING, hr STRING)
LOCATION 'pfile:${system:test.tmp.dir}/fact_tz';

INSERT OVERWRITE TABLE fact_tz PARTITION (ds='1', hr='1')
SELECT key+11 FROM src WHERE key=484;

ALTER TABLE fact_daily SET TBLPROPERTIES('EXTERNAL'='TRUE');
ALTER TABLE fact_daily ADD PARTITION (ds='1')
LOCATION 'pfile:${system:test.tmp.dir}/fact_tz/ds=1';

set mapred.input.dir.recursive=true;
SELECT * FROM fact_daily WHERE ds='1';

SELECT count(1) FROM fact_daily WHERE ds='1';

Issue Links

• is related to: HIVE-3451 map-reduce jobs does not work for a partition containing sub-directories