[SENTRY-565] Improve performance of filtering Hive SHOW commands

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7.0
• Assignee: Colin
• Reporter: Colin
• Created: 05/Dec/14 05:39
• Updated: 25/Nov/15 06:19
• Resolved: 25/Nov/15 06:19

Description

Currently, when get the metadata from hive, eg, "show tables", "show databases". Sentry will filter the result and output the authorized entities. There will be many RPC calls when filtering the result. The related code is in HiveAuthzBinding, for example, in filterShowTables:

......
for (String tableName : queryResult) {
  ......
  hiveAuthzBinding.authorize(operation, tableMetaDataPrivilege, subject, inputHierarchy,
            outputHierarchy, providedPrivileges);
  ......
}
......

hiveAuthzBinding.authorize will get the privileges from sentry service, if there are many tables in the hive, the filtering process will spend much time. Considering sentry also need to filter the column, HiveAuthzBinding should be improved to reduce the number of rpc calls when doing the filter.

Issue Links

• is blocked by: SENTRY-570 Bug fixing for the test case "TestMetaStoreWithPigHCat"
• links to: RB