Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-10426

Add shuffle Streaming Expression

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Resolved
    • None
    • 6.6, 7.0
    • None
    • None

    Description

      Currently the concept of MapReduce shuffling is lumped into the search Streaming Expression. This causes quite a bit of confusion as users sometimes perform a search using the /select handler by default, but actually wanted shuffling behavior which requires the /export handler.

      We can solve this problem by creating a separate function called shuffle that always uses the /export handler.

      This will also allow us to clean up some behaviors in the search expression that are somewhat unexpected in future tickets.

          parallel(workers, 
                   unique(shuffle(collection1, 
                                  q=*:*, 
                                  fl="id,a_s,a_i,a_f", 
                                  sort="a_f asc, a_i asc", 
                                  partitionKeys="a_f"), 
                          over="a_f"), 
                   workers="2",
                   sort="a_f asc")
      

      Attachments

        1. SOLR-10426.patch
          17 kB
          Joel Bernstein

        Activity

          People

            jbernste Joel Bernstein
            jbernste Joel Bernstein
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: