Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3892

Add a useful intblock postings format (eg, FOR, PFOR, PFORDelta, Simple9/16/64, etc.)

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0, 6.0
    • Component/s: None
    • Lucene Fields:
      New

      Description

      On the flex branch we explored a number of possible intblock
      encodings, but for whatever reason never brought them to completion.
      There are still a number of issues opened with patches in different
      states.

      Initial results (based on prototype) were excellent (see
      http://blog.mikemccandless.com/2010/08/lucene-performance-with-pfordelta-codec.html
      ).

      I think this would make a good GSoC project.

        Attachments

        1. LUCENE-3892-trunk.patch
          2.75 MB
          Michael McCandless
        2. LUCENE-3892-pfor-compress-slow-estimate.patch
          36 kB
          Han Jiang
        3. LUCENE-3892-pfor-compress-iterate-numbits.patch
          31 kB
          Han Jiang
        4. LUCENE-3892-non-specialized.patch
          7 kB
          Michael McCandless
        5. LUCENE-3892-liveregs.patch
          4 kB
          Michael McCandless
        6. LUCENE-3892-javadocs.patch
          19 kB
          Michael McCandless
        7. LUCENE-3892-handle_open_files.patch
          2 kB
          Han Jiang
        8. LUCENE-3892-for&pfor-with-javadoc.patch
          29 kB
          Han Jiang
        9. LUCENE-3892-direct-IntBuffer.patch
          148 kB
          Michael McCandless
        10. LUCENE-3892-bulkVInt.patch
          5 kB
          Michael McCandless
        11. LUCENE-3892-BlockTermScorer.patch
          10 kB
          Michael McCandless
        12. LUCENE-3892-blockpfor.patch
          15 kB
          Han Jiang
        13. LUCENE-3892-blockFor-with-packedints-decoder.patch
          27 kB
          Han Jiang
        14. LUCENE-3892-blockFor-with-packedints-decoder.patch
          27 kB
          Han Jiang
        15. LUCENE-3892-blockFor-with-packedints.patch
          17 kB
          Han Jiang
        16. LUCENE-3892-blockFor&packedecoder(comp).patch
          76 kB
          Han Jiang
        17. LUCENE-3892-blockFor&hardcode(base).patch
          83 kB
          Han Jiang
        18. LUCENE-3892_settings.patch
          6 kB
          Robert Muir
        19. LUCENE-3892_settings.patch
          9 kB
          Robert Muir
        20. LUCENE-3892_pulsing_support.patch
          12 kB
          Han Jiang
        21. LUCENE-3892_pfor_unfold_method.patch
          148 kB
          Han Jiang
        22. LUCENE-3892_for_unfold_method.patch
          139 kB
          Han Jiang
        23. LUCENE-3892_for_int[].patch
          89 kB
          Han Jiang
        24. LUCENE-3892_for_byte[].patch
          131 kB
          Han Jiang

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                mikemccand Michael McCandless
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: