Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4
    • Fix Version/s: 2.9
    • Component/s: modules/other
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      According to the thread in java-dev (http://www.gossamer-threads.com/lists/lucene/java-dev/67807 and http://www.gossamer-threads.com/lists/lucene/java-dev/67839), I want to include my fast numerical range query implementation into lucene contrib-queries.

      I implemented (based on RangeFilter) another approach for faster
      RangeQueries, based on longs stored in index in a special format.

      The idea behind this is to store the longs in different precision in index
      and partition the query range in such a way, that the outer boundaries are
      search using terms from the highest precision, but the center of the search
      Range with lower precision. The implementation stores the longs in 8
      different precisions (using a class called TrieUtils). It also has support
      for Doubles, using the IEEE 754 floating-point "double format" bit layout
      with some bit mappings to make them binary sortable. The approach is used in
      rather big indexes, query times are even on low performance desktop
      computers <<100 ms for very big ranges on indexes with 500000 docs.

      I called this RangeQuery variant and format "TrieRangeRange" query because
      the idea looks like the well-known Trie structures (but it is not identical
      to real tries, but algorithms are related to it).

      1. fixbuild-LUCENE-1470.patch
        2 kB
        Uwe Schindler
      2. fixbuild-LUCENE-1470.patch
        0.7 kB
        Uwe Schindler
      3. LUCENE-1470.patch
        56 kB
        Uwe Schindler
      4. LUCENE-1470.patch
        56 kB
        Uwe Schindler
      5. LUCENE-1470.patch
        51 kB
        Uwe Schindler
      6. LUCENE-1470.patch
        48 kB
        Uwe Schindler
      7. LUCENE-1470.patch
        40 kB
        Uwe Schindler
      8. LUCENE-1470.patch
        39 kB
        Uwe Schindler
      9. LUCENE-1470.patch
        32 kB
        Uwe Schindler
      10. LUCENE-1470-apichange.patch
        8 kB
        Uwe Schindler
      11. LUCENE-1470-readme.patch
        2 kB
        Uwe Schindler
      12. LUCENE-1470-revamp.patch
        153 kB
        Uwe Schindler
      13. LUCENE-1470-revamp.patch
        149 kB
        Uwe Schindler
      14. LUCENE-1470-revamp.patch
        115 kB
        Uwe Schindler
      15. trie.zip
        9 kB
        Uwe Schindler
      16. TrieRangeFilter.java
        11 kB
        Uwe Schindler
      17. TrieUtils.java
        13 kB
        Yonik Seeley
      18. TrieUtils.java
        11 kB
        Uwe Schindler
      19. TrieUtils.java
        9 kB
        Uwe Schindler
      20. TrieUtils.java
        8 kB
        Uwe Schindler
      21. TrieUtils.java
        3 kB
        Yonik Seeley

        Issue Links

          Activity

          Mark Thomas made changes -
          Workflow Default workflow, editable Closed status [ 12563100 ] jira [ 12584071 ]
          Mark Thomas made changes -
          Workflow jira [ 12447062 ] Default workflow, editable Closed status [ 12563100 ]
          Uwe Schindler made changes -
          Link This issue relates to LUCENE-1372 [ LUCENE-1372 ]
          Shalin Shekhar Mangar made changes -
          Link This issue relates to SOLR-940 [ SOLR-940 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470-apichange.patch [ 12400706 ]
          Uwe Schindler made changes -
          Status Reopened [ 4 ] Closed [ 6 ]
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Summary Add TrieRangeQuery to contrib Add TrieRangeFilter to contrib
          Uwe Schindler made changes -
          Attachment LUCENE-1470-revamp.patch [ 12400191 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470-revamp.patch [ 12399956 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470-revamp.patch [ 12399865 ]
          Uwe Schindler made changes -
          Attachment trie.zip [ 12399775 ]
          Yonik Seeley made changes -
          Attachment TrieUtils.java [ 12399770 ]
          Uwe Schindler made changes -
          Attachment TrieUtils.java [ 12399769 ]
          Uwe Schindler made changes -
          Attachment TrieRangeFilter.java [ 12399768 ]
          Uwe Schindler made changes -
          Attachment TrieUtils.java [ 12399767 ]
          Uwe Schindler made changes -
          Attachment TrieUtils.java [ 12399742 ]
          Uwe Schindler made changes -
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Assignee Michael McCandless [ mikemccand ] Uwe Schindler [ thetaphi ]
          Yonik Seeley made changes -
          Attachment TrieUtils.java [ 12399728 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470-readme.patch [ 12395388 ]
          Michael McCandless made changes -
          Resolution Fixed [ 1 ]
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Status Reopened [ 4 ] Resolved [ 5 ]
          Uwe Schindler made changes -
          Attachment fixbuild-LUCENE-1470.patch [ 12395271 ]
          Uwe Schindler made changes -
          Status Resolved [ 5 ] Reopened [ 4 ]
          Resolution Fixed [ 1 ]
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Uwe Schindler made changes -
          Attachment fixbuild-LUCENE-1470.patch [ 12395266 ]
          Michael McCandless made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Resolution Fixed [ 1 ]
          Fix Version/s 2.9 [ 12312682 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12395203 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12395202 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12395097 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12394852 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12394833 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12394783 ]
          Michael McCandless made changes -
          Assignee Michael McCandless [ mikemccand ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12394742 ]
          Uwe Schindler made changes -
          Attachment LUCENE-1470.patch [ 12394741 ]
          Uwe Schindler made changes -
          Lucene Fields [Patch Available, New] [New, Patch Available]
          Affects Version/s 2.4 [ 12312681 ]
          Uwe Schindler made changes -
          Link This issue is related to LUCENE-1461 [ LUCENE-1461 ]
          Uwe Schindler made changes -
          Field Original Value New Value
          Attachment LUCENE-1470.patch [ 12394741 ]
          Uwe Schindler created issue -

            People

            • Assignee:
              Uwe Schindler
              Reporter:
              Uwe Schindler
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development