Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2295

Create a MaxFieldLengthAnalyzer to wrap any other Analyzer and provide the same functionality as MaxFieldLength provided on IndexWriter

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1, 4.0-ALPHA
    • Component/s: modules/analysis
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      A spinoff from LUCENE-2294. Instead of asking the user to specify on IndexWriter his requested MFL limit, we can get rid of this setting entirely by providing an Analyzer which will wrap any other Analyzer and its TokenStream with a TokenFilter that keeps track of the number of tokens produced and stop when the limit has reached.

      This will remove any count tracking in IW's indexing, which is done even if I specified UNLIMITED for MFL.

      Let's try to do it for 3.1.

        Attachments

        1. LUCENE-2295.patch
          11 kB
          Uwe Schindler
        2. LUCENE-2295-trunk.patch
          13 kB
          Uwe Schindler
        3. LUCENE-2295-2-3x.patch
          23 kB
          Shai Erera
        4. LUCENE-2295-2-trunk.patch
          24 kB
          Shai Erera

          Activity

            People

            • Assignee:
              thetaphi Uwe Schindler
              Reporter:
              shaie Shai Erera
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: