[RANGER-1938] Solr for Audit setup doesn't use DocValues effectively

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6.0, 0.7.0, 0.6.1, 0.6.2, 0.6.3, 0.7.1
• Fix Version/s: 1.0.0, 0.7.2
• Component/s: audit
• Labels: performance
• Assignee: Kevin Risden
• Reporter: Kevin Risden
• Created: 19/Dec/17 22:10
• Updated: 03/Jan/18 02:05
• Resolved: 02/Jan/18 20:26

Description

Ranger uses Ambari Infra Solr (or another Apache Solr install) for storing Ranger Audit events for displaying in Ranger Admin. In our case, we have noticed quite a few Ambari Infra Solr OOM due to Ranger. I've talked with a few other people who are having very similar problems with OOM errors.

I've typed up some details about how the way Ranger is using Solr requires a lot of heap. I've also outlined the fix for this which significantly reduced the amount of heap memory required. I'm an Apache Lucene/Solr committer so this optimization/usage might not be immediately obvious to those using Solr especially version 5.x.

https://risdenk.github.io/2017/12/18/ambari-infra-solr-ranger.html

Issue Links

• is related to: AMBARI-22684 Ambari Infra Solr should use DocValues by default