[HIVE-13185] orc.ReaderImp.ensureOrcFooter() method fails on small text files with IndexOutOfBoundsException

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.0
• Component/s: ORC
• Assignee: Illya Yalovyy
• Reporter: Illya Yalovyy
• Created: 29/Feb/16 21:44
• Updated: 18/Aug/16 01:03
• Resolved: 15/Mar/16 00:00

Description

Steps to reproduce:
1. Create a Text source table with one line of data:

create table src (id int);
insert overwrite table src values (1);

2. Create a target table:

create table trg (id int);

3. Try to load small text file to the target table:

load data inpath 'user/hive/warehouse/src/000000_0' into table trg;

Error message:

FAILED: SemanticException Unable to load data to destination table. Error: java.lang.IndexOutOfBoundsException

Stack trace:

org.apache.hadoop.hive.ql.parse.SemanticException: Unable to load data to destination table. Error: java.lang.IndexOutOfBoundsException
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.ensureFileFormatsMatch(LoadSemanticAnalyzer.java:340)
	at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:224)
	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:242)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:481)
	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:317)
	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1190)
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1285)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1116)
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1104)
...

Issue Links

• duplicates: HIVE-14556 Load data into text table fail caused by IndexOutOfBoundsException