Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-1150

OutofMemoryError on enabling highlighting

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.4
    • 1.4
    • highlighter
    • None

    Description

      Please refer to following mail thread

      http://markmail.org/message/5nhkm5h3ongqlput

      I am testing with 2MB document size and just 500 documents. Indexing is working fine even with 128MB heap size. But on searching Solr throws OOM error. This issue is observed only when we enable highlighting. While indexing I am storing 1 MB text. While searching Solr reads all the 500 documents in the memory. It also reads the complete 1 MB stored field in the memory for all 500 documents. Due to this 500 docs * 1 MB * 2 (2 bytes per char) = 1000 MB memory is required for searching.

      This memory usage can be reduced by reading one document at a time.

      Attachments

        1. SOLR-1150.patch
          2 kB
          Siddharth Gargate
        2. SOLR-1150.patch
          2 kB
          Mark Miller

        Activity

          People

            markrmiller@gmail.com Mark Miller
            sidgate Siddharth Gargate
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: