[RANGER-3518] Limit the query size stored in Audit logs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0, 2.3.0
• Component/s: Ranger
• Assignee: Mahesh Hanumant Bandal
• Reporter: Mahesh Hanumant Bandal
• Created: 18/Nov/21 14:47
• Updated: 16/Apr/22 06:01
• Resolved: 30/Nov/21 16:39

Description

Ranger audit stores complete query as it is in audit logs. If the single query size is too large (i.e reqData > 10MB) it consumes large heap size on hive plugin size. When similar 200-300 queries are executed simultaneously, ranger audit takes up more than half of the heap.

We need to configure ranger to limit the query size stored in Audit logs. We can set value for config "xasecure.audit.solr.limit.query.req.size" in ranger-hive-audit.xml Recommended value is 1024; however default value is set to Integer.MAX_VALUE

Issue Links

• links to: Apache Review Request