Uploaded image for project: 'Ranger'
  1. Ranger
  2. RANGER-1938

Solr for Audit setup doesn't use DocValues effectively

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0, 0.7.0, 0.6.1, 0.6.2, 0.6.3, 0.7.1
    • Fix Version/s: 1.0.0, 0.7.2
    • Component/s: audit
    • Labels:

      Description

      Ranger uses Ambari Infra Solr (or another Apache Solr install) for storing Ranger Audit events for displaying in Ranger Admin. In our case, we have noticed quite a few Ambari Infra Solr OOM due to Ranger. I've talked with a few other people who are having very similar problems with OOM errors.

      I've typed up some details about how the way Ranger is using Solr requires a lot of heap. I've also outlined the fix for this which significantly reduced the amount of heap memory required. I'm an Apache Lucene/Solr committer so this optimization/usage might not be immediately obvious to those using Solr especially version 5.x.

      https://risdenk.github.io/2017/12/18/ambari-infra-solr-ranger.html

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              krisden Kevin Risden
              Reporter:
              krisden Kevin Risden

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment