Solr
  1. Solr
  2. SOLR-3107

Disable random sampling in LangDetectLanguageIdentifierUpdateProcessor

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 3.6, 4.0-ALPHA
    • Fix Version/s: 3.6, 4.0-ALPHA
    • Component/s: contrib - LangId
    • Labels:
      None

      Description

      The language-detection library used by LangDetectLanguageIdentifierUpdateProcessor uses a random sampling feature enabled by default as a means of avoiding local noise in input. The feature has its merits, but it can also be confusing to users who aren't aware of it since it may give different on the same input. I recommend turning it off to prevent confusion.

      1. SOLR-3107.patch
        0.9 kB
        Christian Moen

        Activity

        Christian Moen created issue -
        Christian Moen made changes -
        Field Original Value New Value
        Attachment SOLR-3107.patch [ 12513654 ]
        Hide
        Christian Moen added a comment -

        Attached a trivial patch tested on trunk.

        Show
        Christian Moen added a comment - Attached a trivial patch tested on trunk .
        Hide
        Robert Muir added a comment -

        +1, i neglected to do this when initially adding this... lets fix this.

        Show
        Robert Muir added a comment - +1, i neglected to do this when initially adding this... lets fix this.
        Robert Muir made changes -
        Assignee Robert Muir [ rcmuir ]
        Hide
        Robert Muir added a comment -

        Thanks Christian!

        Show
        Robert Muir added a comment - Thanks Christian!
        Robert Muir made changes -
        Fix Version/s 3.6 [ 12319065 ]
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 4.0 [ 12314992 ]
        Resolution Fixed [ 1 ]
        Uwe Schindler made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        29m 21s 1 Robert Muir 07/Feb/12 18:59
        Resolved Resolved Closed Closed
        457d 15h 40m 1 Uwe Schindler 10/May/13 11:40

          People

          • Assignee:
            Robert Muir
            Reporter:
            Christian Moen
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development