Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-10156

Add significantTerms Streaming Expression

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Resolved
    • Affects Version/s: None
    • Fix Version/s: 6.5
    • Component/s: None
    • Security Level: Public (Default Security Level. Issues are Public)
    • Labels:
      None

      Description

      The significantTerms Streaming Expression will emit a set of terms from a text field within a doc frequency range for a specific query. It will also score the terms based on how many times the terms appear in the result set, and how many times the terms appear in the corpus, and return the top N terms based on this significance score.

      Syntax:

      significantTerms(collection, 
                       q="any query", 
                       field="some_text_field", 
                       minDocFreq="5",   //optional default is 5 documents
                       maxDocFreq=".3", // optional default is no more then 30% of the index (.3)
                       minTermLength="4",  // optional default is 4
                       limit="50")                // optional default is 20
      
      1. SOLR-10156.patch
        36 kB
        Joel Bernstein
      2. SOLR-10156.patch
        30 kB
        Joel Bernstein
      3. SOLR-10156.patch
        23 kB
        Joel Bernstein

        Issue Links

          Activity

          Hide
          joel.bernstein Joel Bernstein added a comment -

          Initial rough patch, no tests yet.

          Show
          joel.bernstein Joel Bernstein added a comment - Initial rough patch, no tests yet.
          Hide
          joel.bernstein Joel Bernstein added a comment -

          Added a simple test case. More work still todo but getting closer.

          Show
          joel.bernstein Joel Bernstein added a comment - Added a simple test case. More work still todo but getting closer.
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit dba733e7aa90bd607fdda0342b94bc17bb717c31 in lucene-solr's branch refs/heads/master from Joel Bernstein
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=dba733e ]

          SOLR-10156: Add significantTerms Streaming Expression

          Show
          jira-bot ASF subversion and git services added a comment - Commit dba733e7aa90bd607fdda0342b94bc17bb717c31 in lucene-solr's branch refs/heads/master from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=dba733e ] SOLR-10156 : Add significantTerms Streaming Expression
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit a0aef2faaf7da56efc8ac4b004e9d3b8dc401e81 in lucene-solr's branch refs/heads/master from Joel Bernstein
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a0aef2f ]

          SOLR-10156: Increase the overfetch

          Show
          jira-bot ASF subversion and git services added a comment - Commit a0aef2faaf7da56efc8ac4b004e9d3b8dc401e81 in lucene-solr's branch refs/heads/master from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=a0aef2f ] SOLR-10156 : Increase the overfetch
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 744fbde1b6d770caafe0d0a4507fea30d08f8152 in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=744fbde ]

          SOLR-10156: Add significantTerms Streaming Expression

          Show
          jira-bot ASF subversion and git services added a comment - Commit 744fbde1b6d770caafe0d0a4507fea30d08f8152 in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=744fbde ] SOLR-10156 : Add significantTerms Streaming Expression
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 66fb1f83d64f5c79cedd4876e19a541eba30aed1 in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=66fb1f8 ]

          SOLR-10156: Increase the overfetch

          Show
          jira-bot ASF subversion and git services added a comment - Commit 66fb1f83d64f5c79cedd4876e19a541eba30aed1 in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=66fb1f8 ] SOLR-10156 : Increase the overfetch
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit efbabf8e2cf770c3dd19fb3faf2e34b8885381ea in lucene-solr's branch refs/heads/master from Joel Bernstein
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=efbabf8 ]

          SOLR-10156: Update CHANGES.txt

          Show
          jira-bot ASF subversion and git services added a comment - Commit efbabf8e2cf770c3dd19fb3faf2e34b8885381ea in lucene-solr's branch refs/heads/master from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=efbabf8 ] SOLR-10156 : Update CHANGES.txt
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 3dbff093bbaa816813592c30f5fc99c78662a7bb in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein
          [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=3dbff09 ]

          SOLR-10156: Update CHANGES.txt

          Show
          jira-bot ASF subversion and git services added a comment - Commit 3dbff093bbaa816813592c30f5fc99c78662a7bb in lucene-solr's branch refs/heads/branch_6x from Joel Bernstein [ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=3dbff09 ] SOLR-10156 : Update CHANGES.txt

            People

            • Assignee:
              joel.bernstein Joel Bernstein
              Reporter:
              joel.bernstein Joel Bernstein
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development