[HIVE-5277] HBase handler skips rows with null valued first cells when only row key is selected

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.11.0, 0.12.0, 0.11.1, 0.13.0
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: HBase Handler
• Assignee: Swarnim Kulkarni
• Reporter: Teddy Choi
• Created: 12/Sep/13 02:15
• Updated: 16/Feb/16 23:51
• Resolved: 21/Aug/15 18:22

Description

HBaseStorageHandler skips rows with null valued first cells when only row key is selected.

SELECT key, col1, col2 FROM hbase_table;
key1	cell1	cell2 
key2	NULL	cell3

SELECT COUNT(key) FROM hbase_table;
1

HiveHBaseTableInputFormat.getRecordReader makes first cell selected to avoid skipping rows. But when the first cell is null, HBase skips that row.

http://hbase.apache.org/book/perf.reading.html 12.9.6. Optimal Loading of Row Keys describes how to deal with this problem.

I tried to find an existing issue, but I couldn't. If you find a same issue, please make this issue duplicated.

Issue Links

• duplicates: HIVE-7566 HIVE can't count hbase NULL column value properly
• relates to: HIVE-11849 NPE in HiveHBaseTableShapshotInputFormat in query with just count(*)