[IMPALA-9330] Support masking queries containing correlated collection references

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: Impala 3.4.0
• Epic Link: Ranger Column Masking
• Epic Color: ghx-label-8
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 27/Jan/20 15:30
• Updated: 18/Jan/23 03:18
• Resolved: 05/Feb/20 05:47

Description

Let's say table complextypestbl (id bigint, int_arr array<int>) has column masking policy on id: "id => id * 100". The following query is not rewritten correctly:

select t.id, a.pos, a.item from complextypestbl t, t.int_arr a;

Because its AST will be rewritten to the AST of

select t.id, a.pos, a.item from (
  select cast(id * 100 as BIGINT) id
  from complextypestbl
) t, t.int_arr a;

Currently, the analyzer can't resolve "t.int_arr" correctly.

Issue Links

• causes: IMPALA-11845 Select STAR with table ref is not resolved correctly on column/row masked views
• is related to: IMPALA-9329 Table masking view should not have nested columns in select list
• is related to: IMPALA-11847 Refactor table masking views to expose nested columns directly
• links to: Code Review