[HIVE-12877] Hive use index for queries will lose some data if the Query file is compressed.

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.2.1
• Component/s: Indexing

Environment

This problem exists in all Hive versions.no matter what platform

• Assignee: Unassigned
• Reporter: yangfang
• Due: 15/Jan/16
• Created: 15/Jan/16 06:40
• Updated: 01/Feb/16 07:26

Description

Hive created the index using the extracted file length when the file is the compressed,
but when to divide the data into pieces in MapReduce,Hive use the file length to compare with the extracted file length,if
If it found that these two lengths are not matched, It filters out the file.So the query will lose some data.
I modified the source code and make hive index can be used when the files is compressed,please test it.