[LUCENE-10239] upgrade jflex (1.7.0 -> 1.8.2)

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 9.1
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 17/Nov/21 13:27
• Updated: 28/Aug/22 16:30
• Resolved: 19/Nov/21 14:46

Description

When reviewing LUCENE-10238, I noticed we still had unicode 9.0 data specified for our jflex tokenizers.

According to the changelog I see some key benefits from upgrading to jflex 1.8.2:

• unicode 9 -> unicode 12.1
• remove our custom emoji regeneration via ICU, as jflex supports emoji properties directly now.
• Less RAM at runtime to users (two stage tables): https://github.com/jflex-de/jflex/pull/697

https://www.jflex.de/changelog.html

Issue Links

• links to: GitHub Pull Request #452