[TIKA-638] Language recognition - Failed trying to load language profile for language lt . Error: java.lang.IllegalArgumentException: Unable to add an ngram of incorrect length: 5 != 3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.9
• Component/s: languageidentifier

Environment

java version "1.6.0_16"

• Assignee: Kenneth William Krugler
• Reporter: Joseph Vychtrle
• Created: 10/Apr/11 23:45
• Updated: 18/Jan/12 14:28
• Resolved: 18/Jan/12 14:28

Description

Hey, I get this error when simply doing:

return new LanguageIdentifier(text).getLanguage();

It happens in LanguageIdentifier.addProfile(String language);

The exception is not thrown, it's caught and the execution goes on, it finally recognizes the language as "no"

The "text" I'm using as input is this : (note that it is not the log, it's just an input text)

2011-01-24 03:17:19,823 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Successfully completed request
2011-01-24 03:17:22,985 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - DispatcherPortlet with name '1' received render request
2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler map [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping@e579b1f] in DispatcherPortlet with name '1'
2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping] - Key [view] -> handler [{action=example1=cz.instance.transl.portlet.customers.HomeController@736587d2, =cz.instance.transl.portlet.customers.HomeController@736587d2, action=homeView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=invoicesView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=buyCreditView=cz.instance.transl.portlet.customers.HomeController@736587d2, action=example2=cz.instance.transl.portlet.customers.HomeController@736587d2, org.springframework.web.portlet.mvc.annotation.DefaultAnnotationHandlerMapping$ResourceMappingPredicate@4788da4c=cz.instance.transl.portlet.customers.HomeController@736587d2, action=ordersView=cz.instance.transl.portlet.customers.OrdersController@6d543499, action=example22=cz.instance.transl.portlet.customers.InvoicesController@1637a78f}]
2011-01-24 03:17:22,986 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.SimpleControllerHandlerAdapter@776b02a4]
2011-01-24 03:17:22,987 DEBUG [org.springframework.web.portlet.DispatcherPortlet] - Testing handler adapter [org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter@89365f2]
2011-01-24 03:17:22,987 WARN [cz.instance.transl.util.UniversalMappingExceptionResolver] - An Exception has occured in the application
javax.portlet.UnavailableException: No matching handler method found for portlet request: mode 'view', phase 'RENDER_PHASE', parameters map['action' -> array<String>['example22']]
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter$PortletHandlerMethodResolver.resolveHandlerMethod(AnnotationMethodHandlerAdapter.java:480)
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:346)
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.doHandle(AnnotationMethodHandlerAdapter.java:337)
        at org.springframework.web.portlet.mvc.annotation.AnnotationMethodHandlerAdapter.handleRender(AnnotationMethodHandlerAdapter.java:285)
        at org.springframework.web.portlet.DispatcherPortlet.doRenderService(DispatcherPortlet.java:740)
        at org.springframework.web.portlet.FrameworkPortlet.processRequest(FrameworkPortlet.java:522)
        at org.springframework.web.portlet.FrameworkPortlet.doDispatch(FrameworkPortlet.java:470)
        at javax.portlet.GenericPortlet.render(GenericPortlet.java:233)
        at com.liferay.portlet.FilterChainImpl.doFilter(FilterChainImpl.java:100)
        at com.liferay.portal.kernel.portlet.PortletFilterUtil.doFilter(PortletFilterUtil.java:64)
        at com.liferay.portal.kernel.servlet.PortletServlet.service(PortletServlet.java:92)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:646)
        at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:551)
        at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:488)
        at com.liferay.portlet.InvokerPortletImpl.invoke(InvokerPortletImpl.java:639)