Lucene - Core
  1. Lucene - Core
  2. LUCENE-3759

Support joining in a distributed environment.

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: modules/join
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Add two more methods in JoinUtil to support joining in a distributed manner.

      • Method to retrieve all from values.
      • Method to create a TermsQuery based on a set of from terms.

      With these two methods distributed joining can be supported following these steps:

      1. Retrieve from values from each shard
      2. Merge the retrieved from values.
      3. Create a TermsQuery based on the merged from terms and send this query to all shards.

        Activity

        Hide
        Jason Rutherglen added a comment -

        +1 Nice, distributed join will be super useful.

        Show
        Jason Rutherglen added a comment - +1 Nice, distributed join will be super useful.
        Hide
        Alex Liu added a comment -

        is there any performance concern?

        Show
        Alex Liu added a comment - is there any performance concern?
        Hide
        Colin Bartolome added a comment -

        This definitely affects Solr 4.1 and would be very helpful. I might not be able to run with shards without being able to use join queries.

        Show
        Colin Bartolome added a comment - This definitely affects Solr 4.1 and would be very helpful. I might not be able to run with shards without being able to use join queries.
        Hide
        Colin Bartolome added a comment -

        Would implementing this as a TermsQuery open us up to TooManyClauses exceptions?

        Show
        Colin Bartolome added a comment - Would implementing this as a TermsQuery open us up to TooManyClauses exceptions?
        Hide
        Jerry Russell added a comment -

        Is there any progress on this? This seems like a very important feature that is missing from SOLR at this point.

        Show
        Jerry Russell added a comment - Is there any progress on this? This seems like a very important feature that is missing from SOLR at this point.
        Hide
        Erick Erickson added a comment -

        no patches == no progress.

        Show
        Erick Erickson added a comment - no patches == no progress.

          People

          • Assignee:
            Unassigned
            Reporter:
            Martijn van Groningen
          • Votes:
            20 Vote for this issue
            Watchers:
            31 Start watching this issue

            Dates

            • Created:
              Updated:

              Development