[LUCENE-9939] Proper ASCII folding of Danish/Norwegian characters Ø, Å

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Component/s: modules/analysis
• Labels: easyfix patch patch-available
• Lucene Fields: Patch Available
• Review Patch?: Yes
• Assignee: Unassigned
• Reporter: Jacob Lauritzen
• Created: 27/Apr/21 09:00
• Updated: 28/Aug/22 16:21
• Resolved: 28/Apr/21 08:22

Description

The current version of the ASCIIFoldingFilter sets Å, å to A, a and Ø, ø to O, o which I believe is incorrect.

Å was added by Norway as a replacement for the Aa (which is mapped to aa in the AsciiFoldingFilter) in 1917 and by Denmark in 1948. Aa is still used in a lot of names (as an example the second largest city in Denmark was originally named Aarhus, renamed to Århus in 1948 and named back to AArhus in 2010 for internationalization purposes).

The story of Ø is similar. It's equivalent to Œ (which is mapped to oe), not ö (which is mapped to o) and is generally mapped to oe in ascii text.

The third Danish character Æ is already properly mapped to AE.

Issue Links

• is cloned by: LUCENE-9942 CLONE - Proper ASCII folding of Danish/Norwegian characters Ø, Å