Solr
  1. Solr
  2. SOLR-3906

Add support for AnalyzingSuggester / coerce it to work for Japanese

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.1, Trunk
    • Component/s: spellchecker
    • Labels:
      None

      Description

      We should add a factory for this to solr, and try to add a test/example using JapaneseReadingFormFilter, to see if we can at least get some basic auto-suggest working for this language.

      1. SOLR-3906_notestsyet.patch
        6 kB
        Robert Muir
      2. SOLR-3906.patch
        17 kB
        Robert Muir
      3. SOLR-3906.patch
        13 kB
        Robert Muir

        Issue Links

          Activity

          Hide
          Commit Tag Bot added a comment -

          [branch_4x commit] Robert Muir
          http://svn.apache.org/viewvc?view=revision&revision=1400566

          SOLR-3906: add factory for AnalyzingSuggester

          Show
          Commit Tag Bot added a comment - [branch_4x commit] Robert Muir http://svn.apache.org/viewvc?view=revision&revision=1400566 SOLR-3906 : add factory for AnalyzingSuggester
          Hide
          Robert Muir added a comment -

          Attached is an updated patch. I added more test cases and optimized the romaji handling in ReadingFormFilter.

          I will commit this one soon, its just the barebones factory and I won't claim we have great japanese suggester but it does appear to at least roughly work

          Show
          Robert Muir added a comment - Attached is an updated patch. I added more test cases and optimized the romaji handling in ReadingFormFilter. I will commit this one soon, its just the barebones factory and I won't claim we have great japanese suggester but it does appear to at least roughly work
          Hide
          Robert Muir added a comment -

          Updated patch: I added a simple test stolen from Christian Moen 's website. but it seems to be basically working.

          I'm not really sure of all the ins and outs as far as how japanese suggesters should work, so maybe someone else can take it from here

          Note the change to the readingformfilter, the half-width case failed without this (because in that situation its an OOV term).

          Show
          Robert Muir added a comment - Updated patch: I added a simple test stolen from Christian Moen 's website. but it seems to be basically working. I'm not really sure of all the ins and outs as far as how japanese suggesters should work, so maybe someone else can take it from here Note the change to the readingformfilter, the half-width case failed without this (because in that situation its an OOV term).

            People

            • Assignee:
              Unassigned
              Reporter:
              Robert Muir
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development