[IMPALA-10609] NullPointerException in loading tables introduced by ranger masking policies

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Security
• Epic Color: ghx-label-10
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 25/Mar/21 09:09
• Updated: 31/Mar/21 07:33
• Resolved: 31/Mar/21 07:33

Description

Found some NullPointerException logs in logs/fe_tests/FeSupport.INFO when running ranger unit tests, e.g. AuthorizationStmtTest#testInsert:

I0325 17:03:06.550729 11365 AuthorizationTestBase.java:494] Testing authzOk for insert into functional.zipcode_incomes(id) values('123')
E0325 17:03:06.551160 11365 StmtMetadataLoader.java:317] Failed to collect policy tables for functional.zipcode_incomes
Java exception follows:
java.lang.NullPointerException
        at org.apache.impala.authorization.ranger.RangerAuthorizationChecker.evalColumnMask(RangerAuthorizationChecker.java:503)
        at org.apache.impala.authorization.ranger.RangerAuthorizationChecker.needsMaskingOrFiltering(RangerAuthorizationChecker.java:350)
        at org.apache.impala.authorization.TableMask.needsMaskingOrFiltering(TableMask.java:67)
        at org.apache.impala.analysis.StmtMetadataLoader.collectPolicyTables(StmtMetadataLoader.java:351)
        at org.apache.impala.analysis.StmtMetadataLoader.getMissingTables(StmtMetadataLoader.java:315)
        at org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:156)
        at org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:132)
        at org.apache.impala.common.FrontendTestBase.parseAndAnalyze(FrontendTestBase.java:320)
        at org.apache.impala.authorization.AuthorizationTestBase.authzOk(AuthorizationTestBase.java:495)
        at org.apache.impala.authorization.AuthorizationTestBase.authzOk(AuthorizationTestBase.java:488)
        at org.apache.impala.authorization.AuthorizationTestBase.access$300(AuthorizationTestBase.java:74)
        at org.apache.impala.authorization.AuthorizationTestBase$AuthzTest.ok(AuthorizationTestBase.java:331)
        at org.apache.impala.authorization.AuthorizationStmtTest.testInsert(AuthorizationStmtTest.java:794)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
        at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
        at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
        at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
        at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
        at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
        at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
        at org.junit.runners.Suite.runChild(Suite.java:128)
        at org.junit.runners.Suite.runChild(Suite.java:27)
        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
        at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
        at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
        at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
        at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236)
        at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
        at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
        at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)
 

Issue Links

• is caused by: IMPALA-10483 Support column-masking/row-filtering policy expressions that contain subqueries