Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-4540

Allow packed ints norms

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.2, 6.0
    • core/index
    • None
    • New

    Description

      I was curious what the performance would be, because it might be useful option to use packedints for norms if you have lots of fields and still want good scoring:

      Today the smallest norm per-field-per-doc you can use is a single byte, and if you have f fields with norms enabled and n docs, it uses f * n bytes of space in RAM.

      Especially if you aren't using index-time boosting (or even if you are, but not with ridiculous values), this could be wasting a ton of RAM.

      But then I noticed there was no clean way to allow you to do this in your Similarity: its a trivial patch.

      Attachments

        1. LUCENE-4540.patch
          3 kB
          Robert Muir

        Issue Links

          Activity

            People

              rcmuir Robert Muir
              rcmuir Robert Muir
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: