Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-2155

Geospatial search using geohash prefixes

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      NOTICE

      The status of this issue is a plugin for Solr 3.x located here: https://github.com/dsmiley/SOLR-2155. Look at the introductory readme and download the plugin .jar file. Lucene 4's new spatial module is largely based on this code. The Solr 4 glue for it should come very soon but as of this writing it's hosted temporarily at https://github.com/spatial4j. For more information on using SOLR-2155 with Solr 3, see http://wiki.apache.org/solr/SpatialSearch#SOLR-2155 This JIRA issue is closed because it won't be committed in its current form.

      There currently isn't a solution in Solr for doing geospatial filtering on documents that have a variable number of points. This scenario occurs when there is location extraction (i.e. via a "gazateer") occurring on free text. None, one, or many geospatial locations might be extracted from any given document and users want to limit their search results to those occurring in a user-specified area.

      I've implemented this by furthering the GeoHash based work in Lucene/Solr with a geohash prefix based filter. A geohash refers to a lat-lon box on the earth. Each successive character added further subdivides the box into a 4x8 (or 8x4 depending on the even/odd length of the geohash) grid. The first step in this scheme is figuring out which geohash grid squares cover the user's search query. I've added various extra methods to GeoHashUtils (and added tests) to assist in this purpose. The next step is an actual Lucene Filter, GeoHashPrefixFilter, that uses these geohash prefixes in TermsEnum.seek() to skip to relevant grid squares in the index. Once a matching geohash grid is found, the points therein are compared against the user's query to see if it matches. I created an abstraction GeoShape extended by subclasses named PointDistance... and CartesianBox.... to support different queried shapes so that the filter need not care about these details.

      This work was presented at LuceneRevolution in Boston on October 8th.

        Attachments

        1. Solr2155-1.0.4-project.zip
          136 kB
          David Smiley
        2. Solr2155-1.0.3-project.zip
          96 kB
          David Smiley
        3. Solr2155-for-1.0.2-3.x-port.patch
          5 kB
          Mikhail Khludnev
        4. Solr2155-1.0.2-project.zip
          95 kB
          David Smiley
        5. SOLR-2155_GeoHashPrefixFilter_with_sorting_no_poly.patch
          177 kB
          David Smiley
        6. SOLR.2155.p3tests.patch
          86 kB
          Bill Bell
        7. SOLR.2155.p3.patch
          10 kB
          Bill Bell
        8. GeoHashPrefixFilter.patch
          69 kB
          David Smiley
        9. GeoHashPrefixFilter.patch
          49 kB
          David Smiley
        10. GeoHashPrefixFilter.patch
          37 kB
          David Smiley

          Issue Links

            Activity

              People

              • Assignee:
                dsmiley David Smiley
                Reporter:
                dsmiley David Smiley
              • Votes:
                21 Vote for this issue
                Watchers:
                25 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: