Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-10426

Add shuffle Streaming Expression

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Resolved
    • Affects Version/s: None
    • Fix Version/s: 6.6, 7.0
    • Component/s: None
    • Security Level: Public (Default Security Level. Issues are Public)
    • Labels:
      None

      Description

      Currently the concept of MapReduce shuffling is lumped into the search Streaming Expression. This causes quite a bit of confusion as users sometimes perform a search using the /select handler by default, but actually wanted shuffling behavior which requires the /export handler.

      We can solve this problem by creating a separate function called shuffle that always uses the /export handler.

      This will also allow us to clean up some behaviors in the search expression that are somewhat unexpected in future tickets.

          parallel(workers, 
                   unique(shuffle(collection1, 
                                  q=*:*, 
                                  fl="id,a_s,a_i,a_f", 
                                  sort="a_f asc, a_i asc", 
                                  partitionKeys="a_f"), 
                          over="a_f"), 
                   workers="2",
                   sort="a_f asc")
      

        Attachments

        1. SOLR-10426.patch
          17 kB
          Joel Bernstein

          Activity

            People

            • Assignee:
              joel.bernstein Joel Bernstein
              Reporter:
              joel.bernstein Joel Bernstein
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: