[LUCENE-7630] EdgeNGramTokenFilter drops payloads

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 7.0
• Fix Version/s: 6.5, 7.0
• Component/s: modules/analysis
• Lucene Fields: New, Patch Available
• Assignee: Uwe Schindler
• Reporter: Nathan Gass
• Created: 13/Jan/17 12:35
• Updated: 28/Aug/22 15:08
• Resolved: 16/Jan/17 11:14

Description

Using an EdgeNGramTokenFilter after a DelimitedPayloadTokenFilter discards the payloads, where as most other filters copy the payload to the new tokens.

I added a test for this issue and a possible fix at https://github.com/xabbu42/lucene-solr/tree/edgepayloads

Greetings
Nathan Gass

Issue Links

• links to: GitHub Pull Request #138