[HIVE-24285] GlobalLimitOptimizer not working

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 2.0.1, 3.1.2
• Component/s: Query Processor
• Assignee: Unassigned
• Reporter: lucusguo
• Due: 19/Oct/20
• Created: 19/Oct/20 11:01
• Updated: 19/Oct/20 14:50

Description

In our environment，we have set hive.limit.optimize.enable=true,hive.limit.row.max.size=10000000,hive.limit.optimize.fetch.max=1000,hive.fetch.task.conversion.threshold=256000000000000,hive.fetch.task.conversion=more,hive.auto.convert.join=true

when we execute the sql like this,GlobalLimitOptimizer not working.

select db_name,concat('22',cnt) from (select * from lb1 limit 5) t1;

because in this sql there is one LimitOperator, but logs count 2

the code and logs below