Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.4
    • Fix Version/s: 3.2
    • Component/s: search
    • Labels:
      None

      Description

      What's the use case? Sometimes queries are expensive (such as
      regex) or one has indexes located in HDFS, that then need to be
      searched on. By leveraging Hadoop, these non-time sensitive
      queries may be executed without dynamically deploying the
      indexes to new Solr servers.

      We'll download the index out of HDFS (assuming they're zipped),
      perform the queries in a batch on the index shard, then merge
      the results either using a Solr query results priority queue, or
      simply using Hadoop's built in merge sorting.

      The query file will be encoded in JSON format, (ID, query,
      numresults,fields). The shards file will simply contain newline
      delimited paths (HDFS or otherwise). The output can be a Solr
      encoded results file per query.

      I'm hoping to add an actual Hadoop unit test.

        Activity

        Hoss Man made changes -
        Fix Version/s 3.2 [ 12316172 ]
        Fix Version/s Next [ 12315093 ]
        Jason Rutherglen made changes -
        Status Open [ 1 ] Closed [ 6 ]
        Resolution Won't Fix [ 2 ]
        Hoss Man made changes -
        Field Original Value New Value
        Fix Version/s Next [ 12315093 ]
        Fix Version/s 1.5 [ 12313566 ]
        Jason Rutherglen created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Jason Rutherglen
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development