[LUCENE-4991] QueryParser doesnt handle synonyms correctly for chinese

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.3.1, 6.0
• Component/s: modules/queryparser
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 09/May/13 15:06
• Updated: 28/Aug/22 13:45
• Resolved: 10/May/13 17:39

Description

As reported multiple times on the user list:
http://find.searchhub.org/document/eaf0e88a6a0d4d1f
http://find.searchhub.org/document/abf28043c52b6efc
http://find.searchhub.org/document/1313794632c90826

The logic here is not forming the right query structures and ignoring positionIncrementAttribute from the tokenStream.

• when default operator is AND, you can see it more clearly, as synonyms are wrongly inserted as additional MUST terms:
  expected:<+field:中 +(field:国 field:國)>
  but was:<+field:中 +field:国 +field:國>
• even when default operator is OR, its still wrong, because we ignore posInc and this means coord computation is not correct (so scoring is wrong)

This also screws up scoring and queries for decompounding too (because they go thru this exact situation if they add the original compound as a synonym).