[HIVE-21951] Llap query on external table with header or footer returns incorrect row count.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.4.0, 3.2.0, 4.0.0
• Component/s: llap, Query Processor
• Target Version/s: 3.2.0, 4.0.0
• Assignee: Sankar Hariappan
• Reporter: Sankar Hariappan
• Created: 03/Jul/19 17:38
• Updated: 09/Jul/19 04:05
• Resolved: 09/Jul/19 04:05

Description

Create a table with header and footer as follows.

CREATE EXTERNAL TABLE IF NOT EXISTS externaltableOpenCSV (eid int, name String, salary String, destination String)
 COMMENT 'Employee details'
 ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
 STORED AS TEXTFILE
 LOCATION '/externaltableOpenCSV'
 tblproperties ("skip.header.line.count"="1", "skip.footer.line.count"="2");

Now, query on this table returns incorrect row count as header/footer are not skipped.

Issue Links

• Is contained by: HIVE-21924 Split text files even if header/footer exists
• links to: GitHub Pull Request #702