[HIVE-25223] Select with limit returns no rows on non native table

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Attila Magyar
• Reporter: Attila Magyar
• Created: 09/Jun/21 09:50
• Updated: 17/Nov/22 08:47
• Resolved: 10/Jun/21 14:01

Description

Str:

CREATE EXTERNAL TABLE hht (key string, value int) 
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")
TBLPROPERTIES ("hbase.table.name" = "hht", "hbase.mapred.output.outputtable" = "hht");

insert into hht select uuid(), cast((rand() * 1000000) as int);

insert into hht select uuid(), cast((rand() * 1000000) as int) from hht;
insert into hht select uuid(), cast((rand() * 1000000) as int) from hht;
insert into hht select uuid(), cast((rand() * 1000000) as int) from hht;
insert into hht select uuid(), cast((rand() * 1000000) as int) from hht;
insert into hht select uuid(), cast((rand() * 1000000) as int) from hht;
insert into hht select uuid(), cast((rand() * 1000000) as int) from hht;

 set hive.fetch.task.conversion=none;
 select * from hht limit 10;

+----------+------------+
| hht.key  | hht.value  |
+----------+------------+
+----------+------------+
No rows selected (5.22 seconds) 

 

This is caused by GlobalLimitOptimizer. The table directory is always empty with a non native table since the data is not managed by hive (but hbase in this case).

The optimizer scans the directory and sets the file list to an empty list.

Issue Links

• links to: GitHub Pull Request #2375