[HIVE-25278] HiveProjectJoinTransposeRule may do invalid transformations with windowing expressions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 23/Jun/21 11:36
• Updated: 17/Nov/22 08:48
• Resolved: 06/Jul/21 11:33

Description

running

create table table1 (acct_num string, interest_rate decimal(10,7)) stored as orc;
create table table2 (act_id string) stored as orc;
CREATE TABLE temp_output AS
SELECT act_nbr, row_num
FROM (SELECT t2.act_id as act_nbr,
row_number() over (PARTITION BY trim(acct_num) ORDER BY interest_rate DESC) AS row_num
FROM table1 t1
INNER JOIN table2 t2
ON trim(acct_num) = t2.act_id) t
WHERE t.row_num = 1;

may result in error like:

Error: Error while compiling statement: FAILED: SemanticException Line 0:-1 Invalid column reference 'interest_rate': (possible column names are: interest_rate, trim) (state=42000,code=40000)

Issue Links

• is related to: CALCITE-2343 PushProjector with OVER expression causing infinite loop
• links to: GitHub Pull Request #2423