[HIVE-15359] skip.footer.line.count doesnt work properly for certain situations

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.0
• Component/s: Reader
• Assignee: Yongzhi Chen
• Reporter: Yongzhi Chen
• Created: 05/Dec/16 15:39
• Updated: 21/Jul/17 18:26
• Resolved: 08/Dec/16 15:11

Description

This issue's reproduce is very like HIVE-12718 , but the data file is larger than 128M . In this case, even make sure only one mapper is used, the footer is still wrongly skipped.
This issue happens when hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat