|
Description
|
Passing tokens with payloads through SnowballFilter results in tokens with no payloads.
A workaround for this is to apply stemming first and only then run whatever logic creates the payload, but this is not always convenient.
Patch to follow that preserves the payload.
|
Passing tokens with payloads through SnowballFilter results in tokens with no payloads.
A workaround for this is to apply stemming first and only then run whatever logic creates the payload, but this is not always convenient.
Other "consumer" filters have similar problem.
These filters can - and should - reuse the token, by implementing next(Token), effectively also fixing the unwanted resetting.
|
|
Lucene Fields
|
[Patch Available, New]
|
[New, Patch Available]
|
|
Fix Version/s
|
|
2.3.3
[ 12313327
]
|
|
Summary
|
SnowballFilter resets the payload
|
Filters which are "consumers" should not reset the payload or flags and should better reuse the token
|
Bug
Closed
Major
Filters which are "consumers" should not reset the payload or flags and should better reuse the token
