Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3253

Enabling DEBUG in kylin-server-log4j.properties results in NPE in Calcite layer during query execution

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • v2.2.0
    • Backlog
    • Query Engine
    • None
    • HDP 2.5.6, Kylin 2.2

    Description

      If log4j root logger is set to DEBUG level in the kylin-server-log4j.properties attempt to run a query after that results in a failure with an NPE being triggered in the calcite layer (see stack trace below).
      The issue was fixed in Calcite 1.14 as https://issues.apache.org/jira/browse/CALCITE-1859
      It's a one line change to core/src/main/java/org/apache/calcite/plan/volcano/VolcanoPlanner.java

      Since Kylin is packaging it's own fork of Calcite from http://repository.kyligence.io, the fix need to be ported to 1.13.0-kylin-r<?>-SPANSHOT.jar by someone who has access to this forked repo.

                      at org.apache.calcite.avatica.Helper.createException(Helper.java:56)

                      at org.apache.calcite.avatica.Helper.createException(Helper.java:41)

                      at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)

                      at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)

                      at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:834)

                      at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:561)

                      at org.apache.kylin.rest.service.QueryService.query(QueryService.java:181)

                      at org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:415)

                      at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:78)

                      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

                      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

                      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                      at java.lang.reflect.Method.invoke(Method.java:606)

                      at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)

                      at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)

                      at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)

                      at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)

                      at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)

                      at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)

                      at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)

                      at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)

                      at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)

                      at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:872)

                      at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)

                      at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)

                      at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                      at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)

                      at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)

                      at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:215)

                      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64)

                      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)

                      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)

                      at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)

                      at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)

                      at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)

                      at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)

                      at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                      at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)

                      at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)

                      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)

                      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:506)

                      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)

                      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)

                      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:962)

                      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)

                      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)

                      at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1115)

                      at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)

                      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

                      at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

                      at java.lang.Thread.run(Thread.java:745)

      Caused by: java.lang.NullPointerException

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.validate(VolcanoPlanner.java:891)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:866)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101)

                      at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101)

                      at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101)

                      at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101)

                      at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101)

                      at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:863)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:883)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:101)

                      at org.apache.calcite.rel.AbstractRelNode.onRegister(AbstractRelNode.java:336)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1496)

                      at org.apache.calcite.plan.volcano.VolcanoPlanner.setRoot(VolcanoPlanner.java:308)

                      at org.apache.calcite.tools.Programs$5.run(Programs.java:319)

                      at org.apache.calcite.tools.Programs$SequenceProgram.run(Programs.java:397)

                      at org.apache.calcite.prepare.Prepare.optimize(Prepare.java:186)

                      at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:319)

                      at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:228)

                      at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:800)

                      at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:655)

                      at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:617)

                      at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214)

                      at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:603)

                      at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:638)

                      at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:149)

                      ... 82 more

       

      Attachments

        Activity

          People

            Yifei_Wu94 Yifei Wu
            seva_ostapenko Vsevolod Ostapenko
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: