Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-310

Deleting pending handling can cause OOM

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.3
    • None
    • None

    Description

      > Mike:
      >> Could happen when doDeleting the pending docs too. James: try
      >> sending commit every 500k docs or so.

      Yonik:
      > Hmmm, right... some of the memory usage will be related to the treemap
      > keeping track of deleted items, and some of it will be related to the
      > reader itself (the term index, and the norms).

      > Perhaps we should have some sort of limit on the number of deletions
      > we cache so people don't have to worry about that part.

      Good idea. Perhaps a solrconfig.xml setting, <maxPendingDocs>? Default to 100k?

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            klaasm Mike Klaas
            klaasm Mike Klaas
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment