[FLINK-25641] Unexpected aggregate plan after load hive module

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Table SQL / Planner
• Assignee: luoyuxia
• Reporter: Jing Zhang
• Created: 13/Jan/22 08:03
• Updated: 08/Dec/22 08:23
• Resolved: 08/Dec/22 08:23

Description

When using flink batch sql to run hive sql queries, we load hive module to use Hive built-in functions.
However some query plan plan are unexpected after loading hive module.
For the following sql,

load module hive;
use modules hive,core;
set table.sql-dialect=hive;

select
  account_id,
  sum(impression)
from test_db.test_table where dt = '2022-01-10' and hi = '0100' group by account_id

The planner is:

After remove 'load mudiles hive; use modules hive, core;', the planner is:

After loading hive modules, hash aggregate is not final plan because the aggregate function is `HiveAggSqlFunction` and the aggregate buffer is not fixed length which type is as following:

LEGACY('RAW', 'ANY<org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator$AggregationBuffer>')

Issue Links

• is duplicated by: FLINK-29717 Supports hive udaf such as sum/count by native implementation