Description
Sentry can ignore the partitions entries which are located in default location as they share the same permissions as the table. This will reduce the snapshot size decreasing the time to persist the snapshot and also time to send the full update to Namenode. This is important as the partition information has lion’s share in a HMS Full snapshot. Same approach can be taken for tables as well but the issue is that we need to re-construct the location based on the database and table names while constructing the ACL for the table location. This may increase the CPU overhead. With partitions we are safe to ignore the partitions with default location as sentry doesn't support permissions on partitions.
Attachments
Issue Links
- is duplicated by
-
SENTRY-2306 Reduce the HMS snapshot size by ignoring partitions at default locations
-
- Patch Available
-