Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Resolved
    • Affects Version/s: None
    • Fix Version/s: 6.6, 7.0
    • Component/s: None
    • Security Level: Public (Default Security Level. Issues are Public)
    • Labels:
      None

      Description

      Currently the concept of MapReduce shuffling is lumped into the search Streaming Expression. This causes quite a bit of confusion as users sometimes perform a search using the /select handler by default, but actually wanted shuffling behavior which requires the /export handler.

      We can solve this problem by creating a separate function called shuffle that always uses the /export handler.

      This will also allow us to clean up some behaviors in the search expression that are somewhat unexpected in future tickets.

          parallel(workers, 
                   unique(shuffle(collection1, 
                                  q=*:*, 
                                  fl="id,a_s,a_i,a_f", 
                                  sort="a_f asc, a_i asc", 
                                  partitionKeys="a_f"), 
                          over="a_f"), 
                   workers="2",
                   sort="a_f asc")
      
      1. SOLR-10426.patch
        17 kB
        Joel Bernstein

        Activity

        Hide
        joel.bernstein Joel Bernstein added a comment -

        Very simple patch for this.

        Show
        joel.bernstein Joel Bernstein added a comment - Very simple patch for this.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 37b6c60548f3288ee057dbd8ce1e1594ab48d314 in lucene-solr's branch refs/heads/master from Joel Bernstein
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=37b6c60 ]

        SOLR-10426: Add shuffle Streaming Expression

        Show
        jira-bot ASF subversion and git services added a comment - Commit 37b6c60548f3288ee057dbd8ce1e1594ab48d314 in lucene-solr's branch refs/heads/master from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=37b6c60 ] SOLR-10426 : Add shuffle Streaming Expression
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit e606d901e461837ff858595470a0d64fb4bbde1e in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=e606d90 ]

        SOLR-10426: Add shuffle Streaming Expression

        Show
        jira-bot ASF subversion and git services added a comment - Commit e606d901e461837ff858595470a0d64fb4bbde1e in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=e606d90 ] SOLR-10426 : Add shuffle Streaming Expression
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit a0fc9433240ae45878930c87abb58b1bf66f96e7 in lucene-solr's branch refs/heads/master from Joel Bernstein
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a0fc943 ]

        SOLR-10426: Add shuffle Streaming Expression

        Show
        jira-bot ASF subversion and git services added a comment - Commit a0fc9433240ae45878930c87abb58b1bf66f96e7 in lucene-solr's branch refs/heads/master from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a0fc943 ] SOLR-10426 : Add shuffle Streaming Expression
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 8c0503b4d3ecf883c81ccaabcbb14fb28cc6c5d4 in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=8c0503b ]

        SOLR-10426: Add shuffle Streaming Expression

        Show
        jira-bot ASF subversion and git services added a comment - Commit 8c0503b4d3ecf883c81ccaabcbb14fb28cc6c5d4 in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=8c0503b ] SOLR-10426 : Add shuffle Streaming Expression
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 401539758b34279d98c9d25d844ed9435925e938 in lucene-solr's branch refs/heads/master from Joel Bernstein
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=4015397 ]

        SOLR-10426: Add documentation

        Show
        jira-bot ASF subversion and git services added a comment - Commit 401539758b34279d98c9d25d844ed9435925e938 in lucene-solr's branch refs/heads/master from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=4015397 ] SOLR-10426 : Add documentation
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 328229842b61bc98a139c022a975e232172d1b87 in lucene-solr's branch refs/heads/branch_6_6 from Joel Bernstein
        [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=3282298 ]

        SOLR-10426: Add documentation

        Show
        jira-bot ASF subversion and git services added a comment - Commit 328229842b61bc98a139c022a975e232172d1b87 in lucene-solr's branch refs/heads/branch_6_6 from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=3282298 ] SOLR-10426 : Add documentation

          People

          • Assignee:
            joel.bernstein Joel Bernstein
            Reporter:
            joel.bernstein Joel Bernstein
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development