Uploaded image for project: 'Ranger'
  1. Ranger
  2. RANGER-1938

Solr for Audit setup doesn't use DocValues effectively

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0, 0.7.0, 0.6.1, 0.6.2, 0.6.3, 0.7.1
    • Fix Version/s: 1.0.0, 0.7.2
    • Component/s: audit
    • Labels:

      Description

      Ranger uses Ambari Infra Solr (or another Apache Solr install) for storing Ranger Audit events for displaying in Ranger Admin. In our case, we have noticed quite a few Ambari Infra Solr OOM due to Ranger. I've talked with a few other people who are having very similar problems with OOM errors.

      I've typed up some details about how the way Ranger is using Solr requires a lot of heap. I've also outlined the fix for this which significantly reduced the amount of heap memory required. I'm an Apache Lucene/Solr committer so this optimization/usage might not be immediately obvious to those using Solr especially version 5.x.

      https://risdenk.github.io/2017/12/18/ambari-infra-solr-ranger.html

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                risdenk Kevin Risden
                Reporter:
                risdenk Kevin Risden
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: