Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3892

Add a useful intblock postings format (eg, FOR, PFOR, PFORDelta, Simple9/16/64, etc.)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0, 6.0
    • None
    • New

    Description

      On the flex branch we explored a number of possible intblock
      encodings, but for whatever reason never brought them to completion.
      There are still a number of issues opened with patches in different
      states.

      Initial results (based on prototype) were excellent (see
      http://blog.mikemccandless.com/2010/08/lucene-performance-with-pfordelta-codec.html
      ).

      I think this would make a good GSoC project.

      Attachments

        1. LUCENE-3892_for_byte[].patch
          131 kB
          Han Jiang
        2. LUCENE-3892_for_int[].patch
          89 kB
          Han Jiang
        3. LUCENE-3892_for_unfold_method.patch
          139 kB
          Han Jiang
        4. LUCENE-3892_pfor_unfold_method.patch
          148 kB
          Han Jiang
        5. LUCENE-3892_pulsing_support.patch
          12 kB
          Han Jiang
        6. LUCENE-3892_settings.patch
          9 kB
          Robert Muir
        7. LUCENE-3892_settings.patch
          6 kB
          Robert Muir
        8. LUCENE-3892-blockFor&hardcode(base).patch
          83 kB
          Han Jiang
        9. LUCENE-3892-blockFor&packedecoder(comp).patch
          76 kB
          Han Jiang
        10. LUCENE-3892-blockFor-with-packedints.patch
          17 kB
          Han Jiang
        11. LUCENE-3892-blockFor-with-packedints-decoder.patch
          27 kB
          Han Jiang
        12. LUCENE-3892-blockFor-with-packedints-decoder.patch
          27 kB
          Han Jiang
        13. LUCENE-3892-blockpfor.patch
          15 kB
          Han Jiang
        14. LUCENE-3892-BlockTermScorer.patch
          10 kB
          Michael McCandless
        15. LUCENE-3892-bulkVInt.patch
          5 kB
          Michael McCandless
        16. LUCENE-3892-direct-IntBuffer.patch
          148 kB
          Michael McCandless
        17. LUCENE-3892-for&pfor-with-javadoc.patch
          29 kB
          Han Jiang
        18. LUCENE-3892-handle_open_files.patch
          2 kB
          Han Jiang
        19. LUCENE-3892-javadocs.patch
          19 kB
          Michael McCandless
        20. LUCENE-3892-liveregs.patch
          4 kB
          Michael McCandless
        21. LUCENE-3892-non-specialized.patch
          7 kB
          Michael McCandless
        22. LUCENE-3892-pfor-compress-iterate-numbits.patch
          31 kB
          Han Jiang
        23. LUCENE-3892-pfor-compress-slow-estimate.patch
          36 kB
          Han Jiang
        24. LUCENE-3892-trunk.patch
          2.75 MB
          Michael McCandless

        Issue Links

          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-3987 Ivy/maven config to pull from sonatype releases

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. LUCENE-4225 New FixedPostingsFormat for less overhead than SepPostingsFormat

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-4161 Make PackedInts usable by codecs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-4239 Provide access to PackedInts' low-level blocks <-> values conversion methods

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-4283 Support more frequent skip with Block Postings Format

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              Unassigned Unassigned
              mikemccand Michael McCandless
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: