Lucene - Core
  1. Lucene - Core
  2. LUCENE-4993

BeiderMorseFilter inserts tokens with positionIncrement=0, but ignores all custom attributes except OffsetAttribute

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 4.3
    • Fix Version/s: 4.3.1, Trunk
    • Component/s: modules/analysis
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      BeiderMorseFilter inserts sometimes additional phonetic tokens for the same source token. Currently it calls clearAttributes before doing this and sets the new token's term, positionIncrement=0 and the original offset.

      This leads to problems if the TokenStream contains other attributes inserted before (like KeywordAttribute, FlagsAttribute,...). Those are all reverted to defaults for the inserted tokens.

      The TokenFilter should remove the special case done for preserving offsets and instead to captureState() and restoreState().

      1. LUCENE-4993.patch
        4 kB
        Uwe Schindler

        Issue Links

          Activity

          Uwe Schindler created issue -
          Uwe Schindler made changes -
          Field Original Value New Value
          Attachment LUCENE-4993.patch [ 12582540 ]
          Uwe Schindler made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 5.0 [ 12321663 ]
          Resolution Fixed [ 1 ]
          Uwe Schindler made changes -
          Link This issue requires LUCENE-4994 [ LUCENE-4994 ]
          Uwe Schindler made changes -
          Priority Trivial [ 5 ] Major [ 3 ]
          Uwe Schindler made changes -
          Labels lucene-4.3.1-candidate
          Shalin Shekhar Mangar made changes -
          Labels lucene-4.3.1-candidate
          Fix Version/s 4.3.1 [ 12324404 ]
          Fix Version/s 4.4 [ 12324323 ]
          Shalin Shekhar Mangar made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Uwe Schindler
              Reporter:
              Uwe Schindler
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development