Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.2
    • Component/s: modules/analysis
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      It would be nice to have a token filter that limited based on the offset. I suggest the start offset. It should be named LimitTokenOffsetFilter to have a name similar to the other LimitToken*Filter choices, including a "consumeAllTokens" option. I plan to use this filter in LUCENE-6392 (to limit tokens from analyzed text for applicable methods in TokenSources) and in LUCENE-6375.

        Issue Links

          Activity

          Hide
          David Smiley added a comment -

          Here's a patch – very straight-forward. The similar filters offered tests to emulate.

          Show
          David Smiley added a comment - Here's a patch – very straight-forward. The similar filters offered tests to emulate.
          Hide
          ASF subversion and git services added a comment -

          Commit 1675473 from David Smiley in branch 'dev/trunk'
          [ https://svn.apache.org/r1675473 ]

          LUCENE-6423: New LimitTokenOffsetFilter to limit tokens <= a maxStartOffset

          Show
          ASF subversion and git services added a comment - Commit 1675473 from David Smiley in branch 'dev/trunk' [ https://svn.apache.org/r1675473 ] LUCENE-6423 : New LimitTokenOffsetFilter to limit tokens <= a maxStartOffset
          Hide
          ASF subversion and git services added a comment -

          Commit 1675474 from David Smiley in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1675474 ]

          LUCENE-6423: New LimitTokenOffsetFilter to limit tokens <= a maxStartOffset

          Show
          ASF subversion and git services added a comment - Commit 1675474 from David Smiley in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1675474 ] LUCENE-6423 : New LimitTokenOffsetFilter to limit tokens <= a maxStartOffset
          Hide
          ASF subversion and git services added a comment -

          Commit 1675513 from Robert Muir in branch 'dev/trunk'
          [ https://svn.apache.org/r1675513 ]

          LUCENE-6423: blacklist broken variants of LimitTokenOffsetFilter from testing

          Show
          ASF subversion and git services added a comment - Commit 1675513 from Robert Muir in branch 'dev/trunk' [ https://svn.apache.org/r1675513 ] LUCENE-6423 : blacklist broken variants of LimitTokenOffsetFilter from testing
          Hide
          ASF subversion and git services added a comment -

          Commit 1675514 from Robert Muir in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1675514 ]

          LUCENE-6423: blacklist broken variants of LimitTokenOffsetFilter from testing

          Show
          ASF subversion and git services added a comment - Commit 1675514 from Robert Muir in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1675514 ] LUCENE-6423 : blacklist broken variants of LimitTokenOffsetFilter from testing
          Hide
          David Smiley added a comment -

          Thanks Rob. My test runs didn't trip this.

          Show
          David Smiley added a comment - Thanks Rob. My test runs didn't trip this.
          Hide
          Anshum Gupta added a comment -

          Bulk close for 5.2.0.

          Show
          Anshum Gupta added a comment - Bulk close for 5.2.0.

            People

            • Assignee:
              David Smiley
              Reporter:
              David Smiley
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development