[OAK-4804] Synonym analyzer with multiple words in synonym definition can give more results than expected

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: lucene
• Assignee: Vikas Saurabh
• Reporter: Vikas Saurabh
• Created: 14/Sep/16 16:33
• Updated: 16/May/17 09:24

Description

Setting up synonyms such as "FTW, For the win" would also return documents which contain all of "For", "the", "win".

Test case:

    @Test
    public void fulltextSearchWithPhraseSynonymAnalyzer() throws Exception {
        Tree idx = createFulltextIndex(root.getTree("/"), "test");
        TestUtil.useV2(idx);

        Tree anl = idx.addChild(LuceneIndexConstants.ANALYZERS).addChild(LuceneIndexConstants.ANL_DEFAULT);
        anl.addChild(LuceneIndexConstants.ANL_TOKENIZER).setProperty(LuceneIndexConstants.ANL_NAME, "Standard");
        Tree synFilter = anl.addChild(LuceneIndexConstants.ANL_FILTERS).addChild("Synonym");
        synFilter.setProperty("synonyms", "syn.txt");
        synFilter.addChild("syn.txt").addChild(JCR_CONTENT).setProperty(JCR_DATA, "FTW, For the win");

        Tree test = root.getTree("/").addChild("test");
        test.addChild("1").setProperty("foo", "FTW");
        test.addChild("2").setProperty("foo", "For the win");
        test.addChild("3").setProperty("foo", "For gods sake, this is not the way to win it");
        root.commit();

        assertQuery("select * from [nt:base] where CONTAINS(*, 'FTW') AND ISDESCENDANTNODE('/test')",
                asList("/test/1", "/test/2"));//current (failing result is ["/test/1", "/test/2", "/test/3"])
    }

Issue Links

• is related to: OAK-5692 Oak Lucene analyzers docs unclear on viable configurations