[STANBOL-719] Change from Langid to the Langdetect engine as default for Language detection

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Bundlelists
• Assignee: Rupert Westenthaler
• Reporter: Rupert Westenthaler
• Created: 22/Aug/12 14:19
• Updated: 23/Jul/13 13:46
• Resolved: 23/Aug/12 07:45

Description

After looking at the documentation and supported languages of both I think that we should switch from the LangId Engine (based on Apache Tika Language detection) to the Langdetect Engine (based on http://code.google.com/p/language-detection/).

Normal users should not notice any difference as both engines create the same Annotations. However the later supports considerable more languages.

This change will come along with a lot of changes in the integration tests as those check on a lot of places for the LangId Engine. Those need to be changed to the Langdetect Engine.