Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
E-commerce catalogs often use collapse to collapse product records within a group. For example a particular couch might come in different colors or fabrics. So a single couch might have a large number of slightly different records within the group.
When reranking a collapsed query with a vector query the vector query will select the top K matches based on the vector. The top K could include multiple records from within the same product group although only one group head was selected from the group. This will pollute the top K results with lots of duplicate records of no value.
The solution is to devise a filter that limits the vector query to searching only the selected group heads from the collapse.