Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-1150

OutofMemoryError on enabling highlighting

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4
    • Fix Version/s: 1.4
    • Component/s: highlighter
    • Labels:
      None

      Description

      Please refer to following mail thread

      http://markmail.org/message/5nhkm5h3ongqlput

      I am testing with 2MB document size and just 500 documents. Indexing is working fine even with 128MB heap size. But on searching Solr throws OOM error. This issue is observed only when we enable highlighting. While indexing I am storing 1 MB text. While searching Solr reads all the 500 documents in the memory. It also reads the complete 1 MB stored field in the memory for all 500 documents. Due to this 500 docs * 1 MB * 2 (2 bytes per char) = 1000 MB memory is required for searching.

      This memory usage can be reduced by reading one document at a time.

        Attachments

        1. SOLR-1150.patch
          2 kB
          Mark Miller
        2. SOLR-1150.patch
          2 kB
          Siddharth Gargate

          Activity

            People

            • Assignee:
              markrmiller@gmail.com Mark Miller
              Reporter:
              sidgate Siddharth Gargate
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: