2016-12-23 19:36:21,855 INFO [localhost-startStop-1] common.KylinConfig:267 : New KylinConfig 107147390 2016-12-23 19:36:21,871 WARN [localhost-startStop-1] common.KylinConfig:197 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2016-12-23 19:36:21,879 INFO [localhost-startStop-1] common.KylinConfig:62 : Initialized a new KylinConfig from getInstanceFromEnv : 107147390 2016-12-23 19:36:23,771 INFO [localhost-startStop-1] core.SpringSecurityCoreVersion:33 : You are running with Spring Security Core 3.1.2.RELEASE 2016-12-23 19:36:23,772 INFO [localhost-startStop-1] config.SecurityNamespaceHandler:59 : Spring Security 'config' module version is 3.1.2.RELEASE 2016-12-23 19:36:23,817 INFO [localhost-startStop-1] method.GlobalMethodSecurityBeanDefinitionParser:141 : Using bean 'expressionHandler' as method ExpressionHandler implementation 2016-12-23 19:36:23,958 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/user/authentication*/** 2016-12-23 19:36:23,959 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/query*/** 2016-12-23 19:36:23,959 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/metadata*/** 2016-12-23 19:36:23,959 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/**/metrics 2016-12-23 19:36:23,959 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/cache*/** 2016-12-23 19:36:23,960 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasAnyRole('ROLE_ANALYST')' for /api/cubes/src/tables 2016-12-23 19:36:23,960 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/cubes*/** 2016-12-23 19:36:23,960 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/models*/** 2016-12-23 19:36:23,960 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/streaming*/** 2016-12-23 19:36:23,961 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/job*/** 2016-12-23 19:36:23,962 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/admin/config 2016-12-23 19:36:23,962 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/projects 2016-12-23 19:36:23,976 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasRole('ROLE_ADMIN')' for /api/admin*/** 2016-12-23 19:36:23,976 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/** 2016-12-23 19:36:24,030 INFO [localhost-startStop-1] http.AuthenticationConfigBuilder:465 : No login page configured. The default internal one will be used. Use the 'login-page' attribute to set the URL of the login page. 2016-12-23 19:36:24,047 INFO [localhost-startStop-1] http.HttpSecurityBeanDefinitionParser:264 : Checking sorted filter chain: [Root bean: class [org.springframework.security.web.context.SecurityContextPersistenceFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 300, Root bean: class [org.springframework.security.web.authentication.logout.LogoutFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 400, , order = 800, Root bean: class [org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1000, Root bean: class [org.springframework.security.web.authentication.www.BasicAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1200, Root bean: class [org.springframework.security.web.savedrequest.RequestCacheAwareFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1300, Root bean: class [org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1400, Root bean: class [org.springframework.security.web.authentication.AnonymousAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1700, Root bean: class [org.springframework.security.web.session.SessionManagementFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1800, Root bean: class [org.springframework.security.web.access.ExceptionTranslationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1900, , order = 2000] 2016-12-23 19:36:24,611 WARN [localhost-startStop-1] common.KylinConfig:197 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2016-12-23 19:36:24,736 INFO [localhost-startStop-1] security.PasswordPlaceholderConfigurer:172 : Loading properties file from resource loaded through InputStream 2016-12-23 19:36:27,272 INFO [localhost-startStop-1] hbase.HBaseConnection:231 : connection is null or closed, creating a new one 2016-12-23 19:36:30,580 WARN [localhost-startStop-1] client.ClientIdGenerator:85 : Failed to get IP address bytes java.net.SocketException: Can't get our ip address, interfaces are: java.net.NetworkInterface$1@6f44d252 at org.apache.hadoop.hbase.util.Addressing.getIpAddress(Addressing.java:131) at org.apache.hadoop.hbase.util.Addressing.getIpAddress(Addressing.java:86) at org.apache.hadoop.hbase.client.ClientIdGenerator.getIpAddressBytes(ClientIdGenerator.java:83) at org.apache.hadoop.hbase.client.ClientIdGenerator.generateClientId(ClientIdGenerator.java:43) at org.apache.hadoop.hbase.client.PerClientRandomNonceGenerator.(PerClientRandomNonceGenerator.java:37) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:689) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:637) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238) at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218) at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119) at org.apache.kylin.storage.hbase.HBaseConnection.get(HBaseConnection.java:232) at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:265) at org.apache.kylin.rest.security.RealAclHBaseStorage.prepareHBaseTable(RealAclHBaseStorage.java:49) at org.apache.kylin.rest.security.MockAclHBaseStorage.prepareHBaseTable(MockAclHBaseStorage.java:53) at org.apache.kylin.rest.service.AclService.init(AclService.java:121) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:344) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:295) at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:130) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:396) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1507) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:521) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:651) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1077) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:981) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1419) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1160) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:637) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1077) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:981) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:276) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:129) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:637) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1077) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:981) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:276) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:129) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveManagedList(BeanDefinitionValueResolver.java:358) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:157) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:651) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1077) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:981) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:651) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1077) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:981) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:487) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:195) at org.springframework.aop.framework.autoproxy.BeanFactoryAdvisorRetrievalHelper.findAdvisorBeans(BeanFactoryAdvisorRetrievalHelper.java:92) at org.springframework.aop.framework.autoproxy.AbstractAdvisorAutoProxyCreator.findCandidateAdvisors(AbstractAdvisorAutoProxyCreator.java:101) at org.springframework.aop.aspectj.annotation.AnnotationAwareAspectJAutoProxyCreator.findCandidateAdvisors(AnnotationAwareAspectJAutoProxyCreator.java:85) at org.springframework.aop.aspectj.autoproxy.AspectJAwareAdvisorAutoProxyCreator.shouldSkip(AspectJAwareAdvisorAutoProxyCreator.java:103) at org.springframework.aop.framework.autoproxy.AbstractAutoProxyCreator.postProcessBeforeInstantiation(AbstractAutoProxyCreator.java:278) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInstantiation(AbstractAutowireCapableBeanFactory.java:922) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.resolveBeforeInstantiation(AbstractAutowireCapableBeanFactory.java:894) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:448) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1419) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1160) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:195) at org.springframework.aop.framework.autoproxy.BeanFactoryAdvisorRetrievalHelper.findAdvisorBeans(BeanFactoryAdvisorRetrievalHelper.java:92) at org.springframework.aop.framework.autoproxy.AbstractAdvisorAutoProxyCreator.findCandidateAdvisors(AbstractAdvisorAutoProxyCreator.java:101) at org.springframework.aop.aspectj.annotation.AnnotationAwareAspectJAutoProxyCreator.findCandidateAdvisors(AnnotationAwareAspectJAutoProxyCreator.java:85) at org.springframework.aop.aspectj.autoproxy.AspectJAwareAdvisorAutoProxyCreator.shouldSkip(AspectJAwareAdvisorAutoProxyCreator.java:103) at org.springframework.aop.framework.autoproxy.AbstractAutoProxyCreator.postProcessBeforeInstantiation(AbstractAutoProxyCreator.java:278) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInstantiation(AbstractAutowireCapableBeanFactory.java:922) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.resolveBeforeInstantiation(AbstractAutowireCapableBeanFactory.java:894) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:448) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:618) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:938) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:479) at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:410) at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:306) at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:112) at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5068) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5584) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1984) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2016-12-23 19:36:30,830 INFO [localhost-startStop-1] zookeeper.RecoverableZooKeeper:120 : Process identifier=hconnection-0xf278196 connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181 2016-12-23 19:36:30,849 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:zookeeper.version=3.4.6-169--1, built on 02/10/2016 05:49 GMT 2016-12-23 19:36:30,850 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:host.name=sandbox.hortonworks.com 2016-12-23 19:36:30,850 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.version=1.7.0_111 2016-12-23 19:36:30,851 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.vendor=Oracle Corporation 2016-12-23 19:36:30,852 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.111.x86_64/jre 2016-12-23 19:36:30,853 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.class.path=/database/install/kylin/bin/../tomcat/bin/bootstrap.jar:/database/install/kylin/bin/../tomcat/bin/tomcat-juli.jar:/database/install/kylin/bin/../tomcat/lib/kylin-tomcat-ext-1.6.0.jar:/database/install/kylin/bin/../tomcat/lib/ecj-4.4.2.jar:/database/install/kylin/bin/../tomcat/lib/catalina-ant.jar:/database/install/kylin/bin/../tomcat/lib/servlet-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-util.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-jdbc.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-i18n-fr.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-coyote.jar:/database/install/kylin/bin/../tomcat/lib/catalina-ha.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-api.jar:/database/install/kylin/bin/../tomcat/lib/catalina-tribes.jar:/database/install/kylin/bin/../tomcat/lib/catalina.jar:/database/install/kylin/bin/../tomcat/lib/jasper.jar:/database/install/kylin/bin/../tomcat/lib/websocket-api.jar:/database/install/kylin/bin/../tomcat/lib/jsp-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-i18n-ja.jar:/database/install/kylin/bin/../tomcat/lib/annotations-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-dbcp.jar:/database/install/kylin/bin/../tomcat/lib/el-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat7-websocket.jar:/database/install/kylin/bin/../tomcat/lib/jasper-el.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-i18n-es.jar:/database/install/kylin/conf:/database/install/kylin/lib/kylin-jdbc-1.6.0.jar:/database/install/kylin/lib/kylin-job-1.6.0.jar:/database/install/kylin/lib/kylin-coprocessor-1.6.0.jar:/database/install/kylin/tool/kylin-tool-1.6.0.jar:/database/install/kylin/ext/*::/usr/hdp/2.4.0.0-169/hbase/conf:/usr/lib/jvm/java/lib/tools.jar:/usr/hdp/2.4.0.0-169/hbase:/usr/hdp/2.4.0.0-169/hbase/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/aopalliance-1.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hbase/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hbase/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hbase/lib/asm-3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-codec-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-el-1.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-logging-1.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-math-2.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/disruptor-3.3.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/guava-12.0.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/guice-3.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-annotations-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-annotations-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-annotations.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-client-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-client.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-examples-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-examples.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop2-compat-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop2-compat.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop-compat-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop-compat.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-it-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-it-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-it.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-prefix-tree-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-prefix-tree.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-procedure-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-procedure.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-protocol-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-protocol.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-resource-bundle-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-resource-bundle.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-rest-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-rest.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-server-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-server-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-server.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-shell-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-shell.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-thrift-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-thrift.jar:/usr/hdp/2.4.0.0-169/hbase/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hbase/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hbase/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jamon-runtime-2.3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jasper-compiler-5.5.23.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jasper-runtime-5.5.23.jar:/usr/hdp/2.4.0.0-169/hbase/lib/javax.inject-1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jcodings-1.0.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-client-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jettison-1.3.3.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hbase/lib/joni-2.1.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jruby-complete-1.6.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsp-2.1-6.1.14.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsr305-1.3.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hbase/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/libthrift-0.9.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hbase/lib/metrics-core-2.2.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hbase/lib/netty-3.2.4.Final.jar:/usr/hdp/2.4.0.0-169/hbase/lib/netty-all-4.0.23.Final.jar:/usr/hdp/2.4.0.0-169/hbase/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/okhttp-2.4.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/okio-1.4.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hbase/lib/phoenix-server.jar:/usr/hdp/2.4.0.0-169/hbase/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/ranger-hbase-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/2.4.0.0-169/hbase/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hbase/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.4.0.0-169/hbase/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/spymemcached-2.11.6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xml-apis-1.3.04.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/zookeeper.jar:/usr/hdp/2.4.0.0-169/hadoop/conf:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-hdfs-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-yarn-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/spark-yarn-shuffle.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-auth.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-annotations.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-annotations-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-aws.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-aws-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-auth-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-nfs.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-azure.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-azure-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-nfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/./:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/netty-all-4.0.23.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/okhttp-2.4.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/okio-1.4.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/zookeeper-3.4.6.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/fst-2.24.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/objenesis-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/guice-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-client-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-timeline-plugins.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-api-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-timeline-plugins-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-registry-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/guice-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-auth.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-ant-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-extras-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-streaming-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-distcp-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-ant.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-datajoin-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-lang3-3.3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-archives-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-sls-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-auth-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-rumen-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//joda-time-2.9.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-gridmix-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-openstack-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jsr305-3.0.0.jar::mysql-connector-java-5.1.17.jar:mysql-connector-java-5.1.31-bin.jar:mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/tez/tez-runtime-internals-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-mapreduce-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-history-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-history-parser-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-dag-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-runtime-library-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-examples-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-common-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-api-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-tests-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.4.0.0-169/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-mapreduce-client-core-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-yarn-server-web-proxy-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.4.0.0-169/tez/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-annotations-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-mapreduce-client-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-aws-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-azure-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-yarn-server-timeline-plugins-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/conf:/usr/hdp/2.4.0.0-169/hadoop/conf:/usr/hdp/2.4.0.0-169/hadoop/hadoop-auth.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-annotations.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-annotations-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-aws.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-aws-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-auth-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-nfs.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-azure.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-azure-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-nfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-hdfs-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-yarn-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/spark-yarn-shuffle.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/zookeeper/zookeeper.jar:/usr/hdp/2.4.0.0-169/zookeeper/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/nekohtml-1.9.6.2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-plugin-registry-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/classworlds-1.1-alpha-2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-settings-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/commons-codec-1.6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/ant-1.8.0.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-profile-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-lightweight-1.0-beta-6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/ant-launcher-1.8.0.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-shared-1.0-beta-6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-provider-api-2.4.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/commons-logging-1.1.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-ant-tasks-2.1.3.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/httpclient-4.2.3.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-project-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/commons-io-2.2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-shared4-2.4.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/httpcore-4.2.3.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/xercesMinimal-1.9.6.2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-2.4.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/plexus-utils-3.0.8.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-api-1.6.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/plexus-container-default-1.0-alpha-9-stable-1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/jline-0.9.94.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/jsoup-1.7.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-log4j12-1.6.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/log4j-1.2.16.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-error-diagnostics-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-artifact-manager-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-model-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-repository-metadata-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/netty-3.7.0.Final.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-file-1.0-beta-6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/backport-util-concurrent-3.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/plexus-interpolation-1.11.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-artifact-2.2.1.jar::/usr/hdp/current/hive-client/conf:/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar:/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar:/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar:/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar:/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar:/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar:/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar:/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar:/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar:/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:36:30,854 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.library.path=:/usr/hdp/2.4.0.0-169/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.4.0.0-169/hadoop/lib/native 2016-12-23 19:36:30,855 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.io.tmpdir=/database/install/kylin/bin/../tomcat/temp 2016-12-23 19:36:30,856 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.compiler= 2016-12-23 19:36:30,857 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:os.name=Linux 2016-12-23 19:36:30,858 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:os.arch=amd64 2016-12-23 19:36:30,859 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:os.version=2.6.32-573.18.1.el6.x86_64 2016-12-23 19:36:30,860 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:user.name=root 2016-12-23 19:36:30,860 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:user.home=/root 2016-12-23 19:36:30,861 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:user.dir=/database/install/kylin/bin 2016-12-23 19:36:30,865 INFO [localhost-startStop-1] zookeeper.ZooKeeper:438 : Initiating client connection, connectString=sandbox.hortonworks.com:2181 sessionTimeout=60000 watcher=hconnection-0xf2781960x0, quorum=sandbox.hortonworks.com:2181, baseZNode=/hbase-unsecure 2016-12-23 19:36:31,244 INFO [localhost-startStop-1-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1019 : Opening socket connection to server sandbox.hortonworks.com/192.168.150.148:2181. Will not attempt to authenticate using SASL (unknown error) 2016-12-23 19:36:31,433 INFO [localhost-startStop-1-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:864 : Socket connection established to sandbox.hortonworks.com/192.168.150.148:2181, initiating session 2016-12-23 19:36:31,595 INFO [localhost-startStop-1-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1279 : Session establishment complete on server sandbox.hortonworks.com/192.168.150.148:2181, sessionid = 0x1592d0cd22f000a, negotiated timeout = 40000 2016-12-23 19:36:41,071 DEBUG [localhost-startStop-1] hbase.HBaseConnection:298 : Creating HTable 'kylin_metadata_acl' 2016-12-23 19:37:04,097 INFO [localhost-startStop-1] client.HBaseAdmin:755 : Created kylin_metadata_acl 2016-12-23 19:37:04,098 DEBUG [localhost-startStop-1] hbase.HBaseConnection:312 : HTable 'kylin_metadata_acl' created 2016-12-23 19:37:06,532 INFO [localhost-startStop-1] init.InitialTaskManager:37 : Kylin service is starting..... 2016-12-23 19:37:07,664 DEBUG [localhost-startStop-1] hbase.HBaseConnection:298 : Creating HTable 'kylin_metadata_user' 2016-12-23 19:37:10,820 INFO [localhost-startStop-1] client.HBaseAdmin:755 : Created kylin_metadata_user 2016-12-23 19:37:10,821 DEBUG [localhost-startStop-1] hbase.HBaseConnection:312 : HTable 'kylin_metadata_user' created 2016-12-23 19:37:10,979 INFO [localhost-startStop-1] badquery.BadQueryHistoryManager:42 : Initializing BadQueryHistoryManager with config kylin_metadata@hbase 2016-12-23 19:37:11,083 INFO [localhost-startStop-1] filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM argument net.sf.ehcache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$ 2016-12-23 19:37:11,109 INFO [localhost-startStop-1] sizeof.JvmInformation:446 : Detected JVM data model settings of: 64-Bit OpenJDK JVM with Compressed OOPs and Concurrent Mark-and-Sweep GC 2016-12-23 19:37:11,413 INFO [localhost-startStop-1] sizeof.AgentLoader:198 : Extracted agent jar to temporary file /database/install/kylin/bin/../tomcat/temp/ehcache-sizeof-agent8130956254758482448.jar 2016-12-23 19:37:11,413 INFO [localhost-startStop-1] sizeof.AgentLoader:138 : Trying to load agent @ /database/install/kylin/bin/../tomcat/temp/ehcache-sizeof-agent8130956254758482448.jar 2016-12-23 19:37:11,466 INFO [localhost-startStop-1] impl.DefaultSizeOfEngine:111 : using Agent sizeof engine 2016-12-23 19:37:12,569 INFO [Thread-11] threadpool.DefaultScheduler:192 : Initializing Job Engine .... 2016-12-23 19:37:12,990 INFO [Thread-11] util.ZookeeperJobLock:59 : zk connection string:sandbox.hortonworks.com:2181 2016-12-23 19:37:12,990 INFO [Thread-11] util.ZookeeperJobLock:60 : schedulerId:/kylin/job_engine/lock/kylin_metadata 2016-12-23 19:37:13,710 INFO [Thread-11] imps.CuratorFrameworkImpl:224 : Starting 2016-12-23 19:37:13,733 INFO [Thread-11] zookeeper.ZooKeeper:438 : Initiating client connection, connectString=sandbox.hortonworks.com:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@7bde31f 2016-12-23 19:37:13,743 INFO [Thread-11-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1019 : Opening socket connection to server sandbox.hortonworks.com/192.168.150.148:2181. Will not attempt to authenticate using SASL (unknown error) 2016-12-23 19:37:13,775 INFO [Thread-11-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:864 : Socket connection established to sandbox.hortonworks.com/192.168.150.148:2181, initiating session 2016-12-23 19:37:13,908 INFO [Thread-11-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1279 : Session establishment complete on server sandbox.hortonworks.com/192.168.150.148:2181, sessionid = 0x1592d0cd22f000b, negotiated timeout = 40000 2016-12-23 19:37:14,066 INFO [Thread-11-EventThread] state.ConnectionStateManager:228 : State change: CONNECTED 2016-12-23 19:37:14,882 INFO [Thread-11] manager.ExecutableManager:76 : Using metadata url: kylin_metadata@hbase 2016-12-23 19:37:14,892 INFO [Thread-11] dao.ExecutableDao:68 : Using metadata url: kylin_metadata@hbase 2016-12-23 19:37:14,953 INFO [Thread-11] persistence.ResourceStore:80 : Using metadata url kylin_metadata@hbase for resource store 2016-12-23 19:37:15,549 DEBUG [Thread-11] hbase.HBaseConnection:277 : HTable 'kylin_metadata' already exists 2016-12-23 19:37:16,139 INFO [localhost-startStop-1] web.DefaultSecurityFilterChain:28 : Creating filter chain: org.springframework.security.web.util.AnyRequestMatcher@1, [org.springframework.security.web.context.SecurityContextPersistenceFilter@2cbd0576, org.springframework.security.web.authentication.logout.LogoutFilter@2db19cec, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@67b56163, org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter@350cdfc6, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@60375b5f, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@524feb52, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@7ce27eb5, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@79ecdd20, org.springframework.security.web.session.SessionManagementFilter@2da99e69, org.springframework.security.web.access.ExceptionTranslationFilter@5adf16ea, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@6c598b41] 2016-12-23 19:37:16,194 DEBUG [Thread-11] metadata.MetadataManager:414 : Reloading SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase 2016-12-23 19:37:17,551 INFO [Thread-11] measure.MeasureTypeFactory:113 : Checking custom measure types from kylin config 2016-12-23 19:37:17,553 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering COUNT_DISTINCT(hllc), class org.apache.kylin.measure.hllc.HLLCMeasureType$Factory 2016-12-23 19:37:17,601 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering COUNT_DISTINCT(bitmap), class org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory 2016-12-23 19:37:17,621 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering TOP_N(topn), class org.apache.kylin.measure.topn.TopNMeasureType$Factory 2016-12-23 19:37:17,626 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering RAW(raw), class org.apache.kylin.measure.raw.RawMeasureType$Factory 2016-12-23 19:37:17,630 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering EXTENDED_COLUMN(extendedcolumn), class org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory 2016-12-23 19:37:17,731 DEBUG [Thread-11] metadata.MetadataManager:423 : Loaded 4 SourceTable(s) 2016-12-23 19:37:17,732 DEBUG [Thread-11] metadata.MetadataManager:356 : Reloading SourceTable exd info from folder kylin_metadata(key='/table_exd')@kylin_metadata@hbase 2016-12-23 19:37:17,768 DEBUG [Thread-11] metadata.MetadataManager:365 : Loaded 0 SourceTable EXD(s) 2016-12-23 19:37:17,768 DEBUG [Thread-11] metadata.MetadataManager:520 : Reloading DataModel from folder kylin_metadata(key='/model_desc')@kylin_metadata@hbase 2016-12-23 19:37:17,864 DEBUG [Thread-11] metadata.MetadataManager:534 : Loaded 1 DataModel(s) 2016-12-23 19:37:17,864 DEBUG [Thread-11] metadata.MetadataManager:400 : Reloading ExternalFilter from folder kylin_metadata(key='/ext_filter')@kylin_metadata@hbase 2016-12-23 19:37:17,942 DEBUG [Thread-11] metadata.MetadataManager:409 : Loaded 0 ExternalFilter(s) 2016-12-23 19:37:17,953 DEBUG [Thread-11] cachesync.Broadcaster:109 : 1 nodes in the cluster: [localhost:7070] 2016-12-23 19:37:28,043 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:38:28,095 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:39:28,041 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:40:28,064 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:41:28,069 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:41:40,700 INFO [Thread-12] threadpool.DefaultScheduler:222 : Shutingdown Job Engine .... 2016-12-23 19:41:40,722 INFO [Thread-3] client.ConnectionManager$HConnectionImplementation:2106 : Closing master protocol: MasterService 2016-12-23 19:41:40,731 INFO [Thread-3] client.ConnectionManager$HConnectionImplementation:1683 : Closing zookeeper sessionid=0x1592d0cd22f000a 2016-12-23 19:41:40,933 INFO [Thread-3] zookeeper.ZooKeeper:684 : Session: 0x1592d0cd22f000a closed 2016-12-23 19:41:40,934 INFO [localhost-startStop-1-EventThread] zookeeper.ClientCnxn:524 : EventThread shut down 2016-12-23 19:50:55,718 INFO [localhost-startStop-1] common.KylinConfig:267 : New KylinConfig 1705755735 2016-12-23 19:50:55,738 WARN [localhost-startStop-1] common.KylinConfig:197 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2016-12-23 19:50:55,748 INFO [localhost-startStop-1] common.KylinConfig:62 : Initialized a new KylinConfig from getInstanceFromEnv : 1705755735 2016-12-23 19:50:57,637 INFO [localhost-startStop-1] core.SpringSecurityCoreVersion:33 : You are running with Spring Security Core 3.1.2.RELEASE 2016-12-23 19:50:57,637 INFO [localhost-startStop-1] config.SecurityNamespaceHandler:59 : Spring Security 'config' module version is 3.1.2.RELEASE 2016-12-23 19:50:57,679 INFO [localhost-startStop-1] method.GlobalMethodSecurityBeanDefinitionParser:141 : Using bean 'expressionHandler' as method ExpressionHandler implementation 2016-12-23 19:50:57,792 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/user/authentication*/** 2016-12-23 19:50:57,795 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/query*/** 2016-12-23 19:50:57,796 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/metadata*/** 2016-12-23 19:50:57,796 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/**/metrics 2016-12-23 19:50:57,797 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/cache*/** 2016-12-23 19:50:57,797 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasAnyRole('ROLE_ANALYST')' for /api/cubes/src/tables 2016-12-23 19:50:57,798 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/cubes*/** 2016-12-23 19:50:57,798 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/models*/** 2016-12-23 19:50:57,799 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/streaming*/** 2016-12-23 19:50:57,799 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/job*/** 2016-12-23 19:50:57,801 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/admin/config 2016-12-23 19:50:57,802 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/projects 2016-12-23 19:50:57,803 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasRole('ROLE_ADMIN')' for /api/admin*/** 2016-12-23 19:50:57,803 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/** 2016-12-23 19:50:57,844 INFO [localhost-startStop-1] http.AuthenticationConfigBuilder:465 : No login page configured. The default internal one will be used. Use the 'login-page' attribute to set the URL of the login page. 2016-12-23 19:50:57,856 INFO [localhost-startStop-1] http.HttpSecurityBeanDefinitionParser:264 : Checking sorted filter chain: [Root bean: class [org.springframework.security.web.context.SecurityContextPersistenceFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 300, Root bean: class [org.springframework.security.web.authentication.logout.LogoutFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 400, , order = 800, Root bean: class [org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1000, Root bean: class [org.springframework.security.web.authentication.www.BasicAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1200, Root bean: class [org.springframework.security.web.savedrequest.RequestCacheAwareFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1300, Root bean: class [org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1400, Root bean: class [org.springframework.security.web.authentication.AnonymousAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1700, Root bean: class [org.springframework.security.web.session.SessionManagementFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1800, Root bean: class [org.springframework.security.web.access.ExceptionTranslationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1900, , order = 2000] 2016-12-23 19:50:58,517 WARN [localhost-startStop-1] common.KylinConfig:197 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2016-12-23 19:50:58,715 INFO [localhost-startStop-1] security.PasswordPlaceholderConfigurer:172 : Loading properties file from resource loaded through InputStream 2016-12-23 19:51:00,561 INFO [localhost-startStop-1] hbase.HBaseConnection:231 : connection is null or closed, creating a new one 2016-12-23 19:51:02,386 INFO [localhost-startStop-1] zookeeper.RecoverableZooKeeper:120 : Process identifier=hconnection-0x18a4dc0b connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181 2016-12-23 19:51:02,477 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:zookeeper.version=3.4.6-169--1, built on 02/10/2016 05:49 GMT 2016-12-23 19:51:02,478 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:host.name=sandbox.hortonworks.com 2016-12-23 19:51:02,479 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.version=1.7.0_111 2016-12-23 19:51:02,480 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.vendor=Oracle Corporation 2016-12-23 19:51:02,481 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.111.x86_64/jre 2016-12-23 19:51:02,482 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.class.path=/database/install/kylin/bin/../tomcat/bin/bootstrap.jar:/database/install/kylin/bin/../tomcat/bin/tomcat-juli.jar:/database/install/kylin/bin/../tomcat/lib/kylin-tomcat-ext-1.6.0.jar:/database/install/kylin/bin/../tomcat/lib/ecj-4.4.2.jar:/database/install/kylin/bin/../tomcat/lib/catalina-ant.jar:/database/install/kylin/bin/../tomcat/lib/servlet-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-util.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-jdbc.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-i18n-fr.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-coyote.jar:/database/install/kylin/bin/../tomcat/lib/catalina-ha.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-api.jar:/database/install/kylin/bin/../tomcat/lib/catalina-tribes.jar:/database/install/kylin/bin/../tomcat/lib/catalina.jar:/database/install/kylin/bin/../tomcat/lib/jasper.jar:/database/install/kylin/bin/../tomcat/lib/websocket-api.jar:/database/install/kylin/bin/../tomcat/lib/jsp-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-i18n-ja.jar:/database/install/kylin/bin/../tomcat/lib/annotations-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-dbcp.jar:/database/install/kylin/bin/../tomcat/lib/el-api.jar:/database/install/kylin/bin/../tomcat/lib/tomcat7-websocket.jar:/database/install/kylin/bin/../tomcat/lib/jasper-el.jar:/database/install/kylin/bin/../tomcat/lib/tomcat-i18n-es.jar:/database/install/kylin/conf:/database/install/kylin/lib/kylin-jdbc-1.6.0.jar:/database/install/kylin/lib/kylin-job-1.6.0.jar:/database/install/kylin/lib/kylin-coprocessor-1.6.0.jar:/database/install/kylin/tool/kylin-tool-1.6.0.jar:/database/install/kylin/ext/*::/usr/hdp/2.4.0.0-169/hbase/conf:/usr/lib/jvm/java/lib/tools.jar:/usr/hdp/2.4.0.0-169/hbase:/usr/hdp/2.4.0.0-169/hbase/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/aopalliance-1.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hbase/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hbase/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hbase/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hbase/lib/asm-3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-codec-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-el-1.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-logging-1.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-math-2.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/disruptor-3.3.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/guava-12.0.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/guice-3.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-annotations-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-annotations-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-annotations.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-client-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-client.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-examples-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-examples.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop2-compat-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop2-compat.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop-compat-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-hadoop-compat.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-it-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-it-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-it.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-prefix-tree-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-prefix-tree.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-procedure-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-procedure.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-protocol-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-protocol.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-resource-bundle-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-resource-bundle.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-rest-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-rest.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-server-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-server-1.1.2.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-server.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-shell-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-shell.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-thrift-1.1.2.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/hbase-thrift.jar:/usr/hdp/2.4.0.0-169/hbase/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hbase/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hbase/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jamon-runtime-2.3.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jasper-compiler-5.5.23.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jasper-runtime-5.5.23.jar:/usr/hdp/2.4.0.0-169/hbase/lib/javax.inject-1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jcodings-1.0.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-client-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jettison-1.3.3.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hbase/lib/joni-2.1.2.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jruby-complete-1.6.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsp-2.1-6.1.14.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/hdp/2.4.0.0-169/hbase/lib/jsr305-1.3.9.jar:/usr/hdp/2.4.0.0-169/hbase/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hbase/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hbase/lib/libthrift-0.9.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hbase/lib/metrics-core-2.2.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hbase/lib/netty-3.2.4.Final.jar:/usr/hdp/2.4.0.0-169/hbase/lib/netty-all-4.0.23.Final.jar:/usr/hdp/2.4.0.0-169/hbase/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/okhttp-2.4.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/okio-1.4.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hbase/lib/phoenix-server.jar:/usr/hdp/2.4.0.0-169/hbase/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/ranger-hbase-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/hdp/2.4.0.0-169/hbase/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hbase/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.4.0.0-169/hbase/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/spymemcached-2.11.6.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xml-apis-1.3.04.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hbase/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hbase/lib/zookeeper.jar:/usr/hdp/2.4.0.0-169/hadoop/conf:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-hdfs-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-yarn-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/spark-yarn-shuffle.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-auth.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-annotations.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-annotations-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-aws.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-aws-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-auth-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-nfs.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-azure.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-azure-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/.//hadoop-nfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/./:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/netty-all-4.0.23.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/xercesImpl-2.9.1.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/xml-apis-1.3.04.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/okhttp-2.4.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/okio-1.4.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-nfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/zookeeper-3.4.6.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/javassist-3.18.1-GA.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/fst-2.24.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-client-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/objenesis-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/guice-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-client-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-tests-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-timeline-plugins.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-web-proxy-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-nodemanager-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-api-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-timeline-plugins-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-yarn/.//hadoop-yarn-registry-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/aopalliance-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/javax.inject-1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/guice-3.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-auth.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-ant-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-core-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-extras-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-streaming-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-app-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-distcp-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-ant.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-datajoin-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-lang3-3.3.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-archives-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-sls-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-auth-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-rumen-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-examples-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//joda-time-2.9.2.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//mockito-all-1.8.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-gridmix-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//metrics-core-3.0.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//hadoop-openstack-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop-mapreduce/.//jsr305-3.0.0.jar::mysql-connector-java-5.1.17.jar:mysql-connector-java-5.1.31-bin.jar:mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/tez/tez-runtime-internals-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-mapreduce-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-history-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-history-parser-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-dag-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-runtime-library-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-examples-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-common-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-cache-plugin-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-history-with-fs-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-api-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-tests-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/tez-yarn-timeline-history-with-acls-0.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/jettison-1.3.4.jar:/usr/hdp/2.4.0.0-169/tez/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/tez/lib/jsr305-2.0.3.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-mapreduce-client-core-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-yarn-server-web-proxy-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/tez/lib/slf4j-api-1.7.5.jar:/usr/hdp/2.4.0.0-169/tez/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/tez/lib/jersey-client-1.9.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-annotations-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-mapreduce-client-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-aws-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-collections4-4.1.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/tez/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/tez/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/tez/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-azure-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/lib/hadoop-yarn-server-timeline-plugins-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/tez/conf:/usr/hdp/2.4.0.0-169/hadoop/conf:/usr/hdp/2.4.0.0-169/hadoop/hadoop-auth.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-annotations.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-annotations-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-aws.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common-2.7.1.2.4.0.0-169-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common-tests.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-aws-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-common-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-auth-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-nfs.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-azure.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-azure-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/hadoop-nfs-2.7.1.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-api-2.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-digester-1.8.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsch-0.1.42.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpcore-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jettison-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jets3t-0.9.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-net-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/junit-4.11.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-framework-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-core-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-configuration-1.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/httpclient-4.2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/guava-11.0.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/netty-3.6.2.Final.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-httpclient-3.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-databind-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/stax-api-1.0-2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-recipes-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xmlenc-0.52.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-hdfs-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jackson-annotations-2.2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-json-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/java-xmlbuilder-0.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/ranger-yarn-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/curator-client-2.7.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/spark-yarn-shuffle.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jersey-server-1.9.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/zookeeper/zookeeper.jar:/usr/hdp/2.4.0.0-169/zookeeper/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/nekohtml-1.9.6.2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-plugin-registry-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/classworlds-1.1-alpha-2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-settings-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/commons-codec-1.6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/ant-1.8.0.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-profile-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-lightweight-1.0-beta-6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/ant-launcher-1.8.0.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-shared-1.0-beta-6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-provider-api-2.4.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/commons-logging-1.1.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-ant-tasks-2.1.3.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/httpclient-4.2.3.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-project-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/commons-io-2.2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-shared4-2.4.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/httpcore-4.2.3.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/xercesMinimal-1.9.6.2.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-http-2.4.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/plexus-utils-3.0.8.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-api-1.6.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/plexus-container-default-1.0-alpha-9-stable-1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/jline-0.9.94.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/jsoup-1.7.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-log4j12-1.6.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/log4j-1.2.16.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-error-diagnostics-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-artifact-manager-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-model-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-repository-metadata-2.2.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/netty-3.7.0.Final.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/wagon-file-1.0-beta-6.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/backport-util-concurrent-3.1.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/plexus-interpolation-1.11.jar:/usr/hdp/2.4.0.0-169/zookeeper/lib/maven-artifact-2.2.1.jar::/usr/hdp/current/hive-client/conf:/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar:/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar:/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar:/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar:/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar:/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar:/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar:/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar:/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar:/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar:/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar:/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar:/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar:/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar:/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:51:02,483 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.library.path=:/usr/hdp/2.4.0.0-169/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.4.0.0-169/hadoop/lib/native 2016-12-23 19:51:02,484 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.io.tmpdir=/database/install/kylin/bin/../tomcat/temp 2016-12-23 19:51:02,484 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:java.compiler= 2016-12-23 19:51:02,485 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:os.name=Linux 2016-12-23 19:51:02,486 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:os.arch=amd64 2016-12-23 19:51:02,487 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:os.version=2.6.32-573.18.1.el6.x86_64 2016-12-23 19:51:02,488 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:user.name=root 2016-12-23 19:51:02,488 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:user.home=/root 2016-12-23 19:51:02,489 INFO [localhost-startStop-1] zookeeper.ZooKeeper:100 : Client environment:user.dir=/database/install/kylin/bin 2016-12-23 19:51:02,492 INFO [localhost-startStop-1] zookeeper.ZooKeeper:438 : Initiating client connection, connectString=sandbox.hortonworks.com:2181 sessionTimeout=60000 watcher=hconnection-0x18a4dc0b0x0, quorum=sandbox.hortonworks.com:2181, baseZNode=/hbase-unsecure 2016-12-23 19:51:02,708 INFO [localhost-startStop-1-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1019 : Opening socket connection to server sandbox.hortonworks.com/192.168.150.148:2181. Will not attempt to authenticate using SASL (unknown error) 2016-12-23 19:51:02,733 INFO [localhost-startStop-1-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:864 : Socket connection established to sandbox.hortonworks.com/192.168.150.148:2181, initiating session 2016-12-23 19:51:02,796 INFO [localhost-startStop-1-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1279 : Session establishment complete on server sandbox.hortonworks.com/192.168.150.148:2181, sessionid = 0x1592d0cd22f000c, negotiated timeout = 40000 2016-12-23 19:51:05,707 DEBUG [localhost-startStop-1] hbase.HBaseConnection:277 : HTable 'kylin_metadata_acl' already exists 2016-12-23 19:51:08,268 INFO [localhost-startStop-1] init.InitialTaskManager:37 : Kylin service is starting..... 2016-12-23 19:51:08,960 DEBUG [localhost-startStop-1] hbase.HBaseConnection:277 : HTable 'kylin_metadata_user' already exists 2016-12-23 19:51:09,237 INFO [localhost-startStop-1] badquery.BadQueryHistoryManager:42 : Initializing BadQueryHistoryManager with config kylin_metadata@hbase 2016-12-23 19:51:09,411 INFO [localhost-startStop-1] filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM argument net.sf.ehcache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$ 2016-12-23 19:51:09,447 INFO [localhost-startStop-1] sizeof.JvmInformation:446 : Detected JVM data model settings of: 64-Bit OpenJDK JVM with Compressed OOPs and Concurrent Mark-and-Sweep GC 2016-12-23 19:51:09,745 INFO [localhost-startStop-1] sizeof.AgentLoader:198 : Extracted agent jar to temporary file /database/install/kylin/bin/../tomcat/temp/ehcache-sizeof-agent8323083622776416212.jar 2016-12-23 19:51:09,746 INFO [localhost-startStop-1] sizeof.AgentLoader:138 : Trying to load agent @ /database/install/kylin/bin/../tomcat/temp/ehcache-sizeof-agent8323083622776416212.jar 2016-12-23 19:51:09,770 INFO [localhost-startStop-1] impl.DefaultSizeOfEngine:111 : using Agent sizeof engine 2016-12-23 19:51:11,523 INFO [Thread-11] threadpool.DefaultScheduler:192 : Initializing Job Engine .... 2016-12-23 19:51:12,038 INFO [Thread-11] util.ZookeeperJobLock:59 : zk connection string:sandbox.hortonworks.com:2181 2016-12-23 19:51:12,038 INFO [Thread-11] util.ZookeeperJobLock:60 : schedulerId:/kylin/job_engine/lock/kylin_metadata 2016-12-23 19:51:12,426 INFO [Thread-11] imps.CuratorFrameworkImpl:224 : Starting 2016-12-23 19:51:12,797 INFO [Thread-11] zookeeper.ZooKeeper:438 : Initiating client connection, connectString=sandbox.hortonworks.com:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@c540228 2016-12-23 19:51:12,912 INFO [Thread-11-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1019 : Opening socket connection to server sandbox.hortonworks.com/192.168.150.148:2181. Will not attempt to authenticate using SASL (unknown error) 2016-12-23 19:51:12,968 INFO [Thread-11-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:864 : Socket connection established to sandbox.hortonworks.com/192.168.150.148:2181, initiating session 2016-12-23 19:51:12,995 INFO [Thread-11-SendThread(sandbox.hortonworks.com:2181)] zookeeper.ClientCnxn:1279 : Session establishment complete on server sandbox.hortonworks.com/192.168.150.148:2181, sessionid = 0x1592d0cd22f000d, negotiated timeout = 40000 2016-12-23 19:51:13,129 INFO [Thread-11-EventThread] state.ConnectionStateManager:228 : State change: CONNECTED 2016-12-23 19:51:14,403 INFO [Thread-11] manager.ExecutableManager:76 : Using metadata url: kylin_metadata@hbase 2016-12-23 19:51:14,410 INFO [Thread-11] dao.ExecutableDao:68 : Using metadata url: kylin_metadata@hbase 2016-12-23 19:51:14,628 INFO [Thread-11] persistence.ResourceStore:80 : Using metadata url kylin_metadata@hbase for resource store 2016-12-23 19:51:14,968 DEBUG [Thread-11] hbase.HBaseConnection:277 : HTable 'kylin_metadata' already exists 2016-12-23 19:51:15,006 DEBUG [Thread-11] metadata.MetadataManager:414 : Reloading SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase 2016-12-23 19:51:15,527 INFO [localhost-startStop-1] web.DefaultSecurityFilterChain:28 : Creating filter chain: org.springframework.security.web.util.AnyRequestMatcher@1, [org.springframework.security.web.context.SecurityContextPersistenceFilter@6e755e14, org.springframework.security.web.authentication.logout.LogoutFilter@5b73abb3, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@70da3ad, org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter@1074b679, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@5e77ca5f, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@a87536d, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@3a761e81, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@20ccc523, org.springframework.security.web.session.SessionManagementFilter@63a28da7, org.springframework.security.web.access.ExceptionTranslationFilter@4502020b, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@6d44392] 2016-12-23 19:51:17,310 INFO [Thread-11] measure.MeasureTypeFactory:113 : Checking custom measure types from kylin config 2016-12-23 19:51:17,312 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering COUNT_DISTINCT(hllc), class org.apache.kylin.measure.hllc.HLLCMeasureType$Factory 2016-12-23 19:51:17,340 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering COUNT_DISTINCT(bitmap), class org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory 2016-12-23 19:51:17,356 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering TOP_N(topn), class org.apache.kylin.measure.topn.TopNMeasureType$Factory 2016-12-23 19:51:17,362 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering RAW(raw), class org.apache.kylin.measure.raw.RawMeasureType$Factory 2016-12-23 19:51:17,367 INFO [Thread-11] measure.MeasureTypeFactory:139 : registering EXTENDED_COLUMN(extendedcolumn), class org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory 2016-12-23 19:51:17,430 DEBUG [Thread-11] metadata.MetadataManager:423 : Loaded 4 SourceTable(s) 2016-12-23 19:51:17,430 DEBUG [Thread-11] metadata.MetadataManager:356 : Reloading SourceTable exd info from folder kylin_metadata(key='/table_exd')@kylin_metadata@hbase 2016-12-23 19:51:17,575 DEBUG [Thread-11] metadata.MetadataManager:365 : Loaded 0 SourceTable EXD(s) 2016-12-23 19:51:17,575 DEBUG [Thread-11] metadata.MetadataManager:520 : Reloading DataModel from folder kylin_metadata(key='/model_desc')@kylin_metadata@hbase 2016-12-23 19:51:18,319 DEBUG [Thread-11] metadata.MetadataManager:534 : Loaded 1 DataModel(s) 2016-12-23 19:51:18,319 DEBUG [Thread-11] metadata.MetadataManager:400 : Reloading ExternalFilter from folder kylin_metadata(key='/ext_filter')@kylin_metadata@hbase 2016-12-23 19:51:18,663 DEBUG [Thread-11] metadata.MetadataManager:409 : Loaded 0 ExternalFilter(s) 2016-12-23 19:51:18,679 DEBUG [Thread-11] cachesync.Broadcaster:109 : 1 nodes in the cluster: [localhost:7070] 2016-12-23 19:51:21,856 DEBUG [http-bio-7070-exec-8] service.AdminService:88 : Get Kylin Runtime Config 2016-12-23 19:51:29,471 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:51:37,283 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:51:38,317 DEBUG [http-bio-7070-exec-2] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:51:38,638 INFO [http-bio-7070-exec-2] project.ProjectManager:89 : Initializing ProjectManager with metadata url kylin_metadata@hbase 2016-12-23 19:51:38,771 DEBUG [http-bio-7070-exec-2] project.ProjectManager:128 : Loading Project from folder kylin_metadata(key='/project')@kylin_metadata@hbase 2016-12-23 19:51:38,802 DEBUG [http-bio-7070-exec-2] project.ProjectManager:133 : Loaded 1 Project(s) 2016-12-23 19:51:38,803 DEBUG [http-bio-7070-exec-2] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:51:39,407 INFO [http-bio-7070-exec-9] cube.CubeManager:136 : Initializing CubeManager with config kylin_metadata@hbase 2016-12-23 19:51:39,498 INFO [http-bio-7070-exec-9] cube.CubeManager:895 : Loading Cube from folder kylin_metadata(key='/cube')@kylin_metadata@hbase 2016-12-23 19:51:39,558 INFO [http-bio-7070-exec-9] cube.CubeDescManager:94 : Initializing CubeDescManager with config kylin_metadata@hbase 2016-12-23 19:51:39,559 INFO [http-bio-7070-exec-9] cube.CubeDescManager:246 : Reloading Cube Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase 2016-12-23 19:51:39,750 INFO [http-bio-7070-exec-9] cube.CubeDescManager:266 : Loaded 1 Cube(s) 2016-12-23 19:51:39,751 INFO [http-bio-7070-exec-9] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 19:51:39,752 INFO [http-bio-7070-exec-9] cube.CubeManager:908 : Loaded 1 cubes, fail on 0 cubes 2016-12-23 19:52:29,004 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:53:29,316 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:54:27,183 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:54:27,209 DEBUG [http-bio-7070-exec-2] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:54:29,047 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:54:58,012 INFO [http-bio-7070-exec-8] project.ProjectManager:166 : Creating project Tutorial 2016-12-23 19:54:58,113 DEBUG [http-bio-7070-exec-8] hbase.HBaseResourceStore:262 : Update row /project/Tutorial.json from oldTs: 0, to newTs: 1482522898014, operation result: true 2016-12-23 19:54:58,117 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=project, event=create, cacheKey=Tutorial} 2016-12-23 19:54:58,204 DEBUG [http-bio-7070-exec-8] service.AclService:240 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.project.ProjectInstance; Identifier: d189515b-62ed-4146-a9bf-c5939cfaaf8b] created successfully. 2016-12-23 19:54:58,248 DEBUG [http-bio-7070-exec-8] service.AclService:307 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.project.ProjectInstance; Identifier: d189515b-62ed-4146-a9bf-c5939cfaaf8b] updated successfully. 2016-12-23 19:54:58,255 DEBUG [http-bio-7070-exec-8] service.ProjectService:64 : New project created. 2016-12-23 19:54:58,918 DEBUG [http-bio-7070-exec-10] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project, event=CREATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41] 2016-12-23 19:54:58,927 DEBUG [http-bio-7070-exec-10] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 19:54:58,928 INFO [http-bio-7070-exec-10] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 19:54:58,934 INFO [http-bio-7070-exec-10] realization.RealizationRegistry:76 : Initializing RealizationRegistry with metadata url kylin_metadata@hbase 2016-12-23 19:54:58,955 INFO [http-bio-7070-exec-10] hybrid.HybridManager:87 : Initializing HybridManager with config kylin_metadata@hbase 2016-12-23 19:54:58,979 DEBUG [http-bio-7070-exec-10] hybrid.HybridManager:131 : Loading Hybrid from folder kylin_metadata(key='/hybrid')@kylin_metadata@hbase 2016-12-23 19:54:58,980 DEBUG [http-bio-7070-exec-10] hybrid.HybridManager:137 : Loaded 0 Hybrid(s) 2016-12-23 19:54:58,981 INFO [http-bio-7070-exec-10] realization.RealizationRegistry:110 : RealizationRegistry is {CUBE=org.apache.kylin.cube.CubeManager@459eb3dc, HYBRID=org.apache.kylin.storage.hybrid.HybridManager@36325439} 2016-12-23 19:54:58,982 INFO [http-bio-7070-exec-10] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 19:54:58,982 INFO [http-bio-7070-exec-10] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 19:54:58,991 DEBUG [http-bio-7070-exec-10] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial 2016-12-23 19:54:58,991 DEBUG [http-bio-7070-exec-10] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:54:58,992 INFO [http-bio-7070-exec-10] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 19:54:58,992 INFO [http-bio-7070-exec-10] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 19:54:58,993 DEBUG [http-bio-7070-exec-10] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=Tutorial 2016-12-23 19:54:58,993 DEBUG [http-bio-7070-exec-10] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project, event=CREATE, cacheKey=Tutorial 2016-12-23 19:54:59,582 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:54:59,596 DEBUG [http-bio-7070-exec-7] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:54:59,664 DEBUG [http-bio-7070-exec-9] service.AdminService:88 : Get Kylin Runtime Config 2016-12-23 19:55:00,072 DEBUG [http-bio-7070-exec-2] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:55:18,326 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:55:18,344 INFO [http-bio-7070-exec-8] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 19:55:18,345 INFO [http-bio-7070-exec-8] controller.TableController:108 : Return all table metadata in 1 seconds 2016-12-23 19:55:29,024 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:55:36,584 INFO [http-bio-7070-exec-10] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 19:55:36,673 INFO [http-bio-7070-exec-10] hive.metastore:478 : Connected to metastore. 2016-12-23 19:56:28,092 INFO [http-bio-7070-exec-4] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 19:56:28,101 INFO [http-bio-7070-exec-4] hive.metastore:478 : Connected to metastore. 2016-12-23 19:56:29,027 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:56:29,196 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /table/DEFAULT.KYLIN_SALES.json from oldTs: 1482521623000, to newTs: 1482522989171, operation result: true 2016-12-23 19:56:29,198 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=table, event=update, cacheKey=DEFAULT.KYLIN_SALES} 2016-12-23 19:56:29,198 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:207 : Directly saving resource /table_exd/DEFAULT.KYLIN_SALES.json (Store kylin_metadata@hbase) 2016-12-23 19:56:29,211 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=table_ext, event=create, cacheKey=DEFAULT.KYLIN_SALES} 2016-12-23 19:56:29,212 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=table, event=UPDATE, cacheKey=DEFAULT.KYLIN_SALES, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b] 2016-12-23 19:56:29,220 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:56:29,225 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 19:56:29,227 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 19:56:29,303 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 19:56:29,304 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 19:56:29,304 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 19:56:29,305 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin 2016-12-23 19:56:29,305 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=table, event=UPDATE, cacheKey=DEFAULT.KYLIN_SALES 2016-12-23 19:56:29,317 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=table_ext, event=CREATE, cacheKey=DEFAULT.KYLIN_SALES, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc] 2016-12-23 19:56:29,323 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:56:29,347 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 19:56:29,347 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 19:56:29,370 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 19:56:29,370 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 19:56:29,371 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 19:56:29,371 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin 2016-12-23 19:56:29,371 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=table_ext, event=CREATE, cacheKey=DEFAULT.KYLIN_SALES 2016-12-23 19:56:29,617 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /table/DEFAULT.KYLIN_CAL_DT.json from oldTs: 1482521623000, to newTs: 1482522989589, operation result: true 2016-12-23 19:56:29,618 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=table, event=update, cacheKey=DEFAULT.KYLIN_CAL_DT} 2016-12-23 19:56:29,618 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:207 : Directly saving resource /table_exd/DEFAULT.KYLIN_CAL_DT.json (Store kylin_metadata@hbase) 2016-12-23 19:56:29,625 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=table, event=UPDATE, cacheKey=DEFAULT.KYLIN_CAL_DT, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b] 2016-12-23 19:56:29,652 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:56:29,663 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 19:56:29,663 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 19:56:29,681 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 19:56:29,681 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 19:56:29,681 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 19:56:29,682 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin 2016-12-23 19:56:29,682 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=table, event=UPDATE, cacheKey=DEFAULT.KYLIN_CAL_DT 2016-12-23 19:56:29,682 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=table_ext, event=create, cacheKey=DEFAULT.KYLIN_CAL_DT} 2016-12-23 19:56:29,706 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=table_ext, event=CREATE, cacheKey=DEFAULT.KYLIN_CAL_DT, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc] 2016-12-23 19:56:29,717 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:56:29,726 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 19:56:29,727 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 19:56:29,747 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 0, to newTs: 1482522989722, operation result: true 2016-12-23 19:56:29,748 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 19:56:29,749 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 19:56:29,749 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 19:56:29,749 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin 2016-12-23 19:56:29,750 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=table_ext, event=CREATE, cacheKey=DEFAULT.KYLIN_CAL_DT 2016-12-23 19:56:29,765 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 0, to newTs: 1482522989748, operation result: true 2016-12-23 19:56:29,784 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 0, to newTs: 1482522989766, operation result: true 2016-12-23 19:56:29,798 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-01 from oldTs: 0, to newTs: 1482522989785, operation result: true 2016-12-23 19:56:29,809 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 0, to newTs: 1482522989801, operation result: true 2016-12-23 19:56:29,819 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 0, to newTs: 1482522989810, operation result: true 2016-12-23 19:56:29,827 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 0, to newTs: 1482522989819, operation result: true 2016-12-23 19:56:29,836 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 from oldTs: 0, to newTs: 1482522989828, operation result: true 2016-12-23 19:56:29,852 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /project/Tutorial.json from oldTs: 1482522898014, to newTs: 1482522989837, operation result: true 2016-12-23 19:56:29,853 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=project, event=update, cacheKey=Tutorial} 2016-12-23 19:56:29,876 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41] 2016-12-23 19:56:29,898 INFO [http-bio-7070-exec-4] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 19:56:29,900 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:56:29,901 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 19:56:29,902 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 19:56:29,902 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 19:56:29,903 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial 2016-12-23 19:56:29,902 INFO [http-bio-7070-exec-4] controller.TableController:108 : Return all table metadata in 4 seconds 2016-12-23 19:56:29,904 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 19:56:29,906 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 19:56:29,906 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 19:56:29,906 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=Tutorial 2016-12-23 19:56:29,907 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project, event=UPDATE, cacheKey=Tutorial 2016-12-23 19:57:29,057 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : DefaultChainedExecutable{id=1f7a1236-43a9-4fb3-9d46-ba36d9128e77, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_SALES', state=READY} prepare to schedule 2016-12-23 19:57:29,061 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : DefaultChainedExecutable{id=1f7a1236-43a9-4fb3-9d46-ba36d9128e77, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_SALES', state=READY} scheduled 2016-12-23 19:57:29,061 INFO [pool-8-thread-1] execution.AbstractExecutable:99 : Executing AbstractExecutable (Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_SALES') 2016-12-23 19:57:29,082 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77 2016-12-23 19:57:29,090 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : DefaultChainedExecutable{id=f5956a79-c608-48a9-93e9-c3ccb166b982, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_CAL_DT', state=READY} prepare to schedule 2016-12-23 19:57:29,091 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : DefaultChainedExecutable{id=f5956a79-c608-48a9-93e9-c3ccb166b982, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_CAL_DT', state=READY} scheduled 2016-12-23 19:57:29,092 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 2 actual running, 2 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:57:29,091 INFO [pool-8-thread-2] execution.AbstractExecutable:99 : Executing AbstractExecutable (Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_CAL_DT') 2016-12-23 19:57:29,097 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 1482522989810, to newTs: 1482523049084, operation result: true 2016-12-23 19:57:29,097 INFO [pool-8-thread-1] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from READY to RUNNING 2016-12-23 19:57:29,109 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982 2016-12-23 19:57:29,117 INFO [pool-8-thread-1] execution.AbstractExecutable:99 : Executing AbstractExecutable (null) 2016-12-23 19:57:29,125 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 1482522989748, to newTs: 1482523049109, operation result: true 2016-12-23 19:57:29,125 INFO [pool-8-thread-2] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982 from READY to RUNNING 2016-12-23 19:57:29,133 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:57:29,138 INFO [pool-8-thread-2] execution.AbstractExecutable:99 : Executing AbstractExecutable (null) 2016-12-23 19:57:29,145 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482522989819, to newTs: 1482523049133, operation result: true 2016-12-23 19:57:29,145 INFO [pool-8-thread-1] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from READY to RUNNING 2016-12-23 19:57:29,157 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:57:29,169 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482522989766, to newTs: 1482523049157, operation result: true 2016-12-23 19:57:29,169 INFO [pool-8-thread-2] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982-00 from READY to RUNNING 2016-12-23 19:57:29,331 INFO [pool-8-thread-1] common.MapReduceExecutable:112 : parameters of the MapReduceExecutable: 2016-12-23 19:57:29,331 INFO [pool-8-thread-1] common.MapReduceExecutable:113 : -table DEFAULT.KYLIN_SALES -output /tmp/kylin/cardinality/DEFAULT.KYLIN_SALES 2016-12-23 19:57:29,346 INFO [pool-8-thread-1] common.AbstractHadoopJob:69 : Starting: Kylin Hive Column Cardinality Job table=DEFAULT.KYLIN_SALES output=/tmp/kylin/cardinality/DEFAULT.KYLIN_SALES 2016-12-23 19:57:29,347 INFO [pool-8-thread-1] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 19:57:29,386 INFO [pool-8-thread-2] common.MapReduceExecutable:112 : parameters of the MapReduceExecutable: 2016-12-23 19:57:29,392 INFO [pool-8-thread-2] common.MapReduceExecutable:113 : -table DEFAULT.KYLIN_CAL_DT -output /tmp/kylin/cardinality/DEFAULT.KYLIN_CAL_DT 2016-12-23 19:57:29,392 INFO [pool-8-thread-2] common.AbstractHadoopJob:69 : Starting: Kylin Hive Column Cardinality Job table=DEFAULT.KYLIN_CAL_DT output=/tmp/kylin/cardinality/DEFAULT.KYLIN_CAL_DT 2016-12-23 19:57:29,397 INFO [pool-8-thread-2] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 19:57:29,512 INFO [pool-8-thread-1] common.AbstractHadoopJob:163 : append job jar: /database/install/kylin/lib/kylin-job-1.6.0.jar 2016-12-23 19:57:29,512 INFO [pool-8-thread-1] common.AbstractHadoopJob:171 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-12-23 19:57:29,513 INFO [pool-8-thread-1] common.AbstractHadoopJob:188 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-12-23 19:57:29,513 INFO [pool-8-thread-1] common.AbstractHadoopJob:200 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:57:29,531 INFO [pool-8-thread-2] common.AbstractHadoopJob:163 : append job jar: /database/install/kylin/lib/kylin-job-1.6.0.jar 2016-12-23 19:57:29,535 INFO [pool-8-thread-2] common.AbstractHadoopJob:171 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-12-23 19:57:29,535 INFO [pool-8-thread-2] common.AbstractHadoopJob:188 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-12-23 19:57:29,536 INFO [pool-8-thread-2] common.AbstractHadoopJob:200 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:57:29,577 INFO [pool-8-thread-1] common.AbstractHadoopJob:202 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:57:29,582 INFO [pool-8-thread-1] common.AbstractHadoopJob:230 : Kafka Dependencies: 2016-12-23 19:57:29,588 INFO [pool-8-thread-2] common.AbstractHadoopJob:202 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:57:29,589 INFO [pool-8-thread-2] common.AbstractHadoopJob:230 : Kafka Dependencies: 2016-12-23 19:57:29,742 INFO [pool-8-thread-2] common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:57:29,743 INFO [pool-8-thread-1] common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 19:57:29,744 INFO [pool-8-thread-2] Configuration.deprecation:1173 : dfs.block.size is deprecated. Instead, use dfs.blocksize 2016-12-23 19:57:30,562 INFO [pool-8-thread-2] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 19:57:30,579 INFO [pool-8-thread-2] hive.metastore:478 : Connected to metastore. 2016-12-23 19:57:30,818 INFO [pool-8-thread-1] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 19:57:30,924 INFO [pool-8-thread-1] hive.metastore:478 : Connected to metastore. 2016-12-23 19:57:33,046 INFO [pool-8-thread-2] common.AbstractHadoopJob:104 : Going to submit HiveColumnCardinalityJob for table 'DEFAULT.KYLIN_CAL_DT' 2016-12-23 19:57:33,164 INFO [pool-8-thread-1] common.AbstractHadoopJob:104 : Going to submit HiveColumnCardinalityJob for table 'DEFAULT.KYLIN_SALES' 2016-12-23 19:57:33,185 INFO [pool-8-thread-2] common.KylinConfig:120 : The URI /database/install/kylin/bin/../tomcat/temp/kylin_job_meta5192190183554686049/meta is recognized as LOCAL_FOLDER 2016-12-23 19:57:33,186 INFO [pool-8-thread-2] common.KylinConfig:267 : New KylinConfig 1320193970 2016-12-23 19:57:33,186 INFO [pool-8-thread-2] common.KylinConfigBase:130 : Kylin Config was updated with kylin.metadata.url : /database/install/kylin/bin/../tomcat/temp/kylin_job_meta5192190183554686049/meta 2016-12-23 19:57:33,187 INFO [pool-8-thread-2] persistence.ResourceStore:80 : Using metadata url /database/install/kylin/bin/../tomcat/temp/kylin_job_meta5192190183554686049/meta for resource store 2016-12-23 19:57:33,196 DEBUG [pool-8-thread-2] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_CAL_DT.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta5192190183554686049/meta) 2016-12-23 19:57:33,197 INFO [pool-8-thread-2] common.AbstractHadoopJob:499 : HDFS meta dir is: file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta5192190183554686049/meta 2016-12-23 19:57:33,197 INFO [pool-8-thread-2] common.AbstractHadoopJob:372 : Job 'tmpfiles' updated -- file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta5192190183554686049/meta 2016-12-23 19:57:33,188 INFO [pool-8-thread-1] common.KylinConfig:120 : The URI /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6836716364388606555/meta is recognized as LOCAL_FOLDER 2016-12-23 19:57:33,218 INFO [pool-8-thread-1] common.KylinConfig:267 : New KylinConfig 1914218626 2016-12-23 19:57:33,218 INFO [pool-8-thread-1] common.KylinConfigBase:130 : Kylin Config was updated with kylin.metadata.url : /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6836716364388606555/meta 2016-12-23 19:57:33,264 INFO [pool-8-thread-1] persistence.ResourceStore:80 : Using metadata url /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6836716364388606555/meta for resource store 2016-12-23 19:57:33,276 DEBUG [pool-8-thread-1] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_SALES.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6836716364388606555/meta) 2016-12-23 19:57:33,277 INFO [pool-8-thread-1] common.AbstractHadoopJob:499 : HDFS meta dir is: file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta6836716364388606555/meta 2016-12-23 19:57:33,277 INFO [pool-8-thread-1] common.AbstractHadoopJob:372 : Job 'tmpfiles' updated -- file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta6836716364388606555/meta 2016-12-23 19:57:34,430 INFO [pool-8-thread-2] impl.TimelineClientImpl:352 : Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-12-23 19:57:34,882 INFO [pool-8-thread-2] client.RMProxy:98 : Connecting to ResourceManager at sandbox.hortonworks.com/192.168.150.148:8050 2016-12-23 19:57:36,008 INFO [pool-8-thread-1] impl.TimelineClientImpl:352 : Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-12-23 19:57:36,133 INFO [pool-8-thread-1] client.RMProxy:98 : Connecting to ResourceManager at sandbox.hortonworks.com/192.168.150.148:8050 2016-12-23 19:57:44,977 INFO [pool-8-thread-1] Configuration.deprecation:1173 : mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir 2016-12-23 19:57:45,168 INFO [pool-8-thread-1] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 19:57:45,304 INFO [pool-8-thread-2] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 19:57:45,595 INFO [pool-8-thread-1] mapreduce.JobSubmitter:198 : number of splits:1 2016-12-23 19:57:45,623 INFO [pool-8-thread-2] mapreduce.JobSubmitter:198 : number of splits:1 2016-12-23 19:57:46,210 INFO [pool-8-thread-2] mapreduce.JobSubmitter:287 : Submitting tokens for job: job_1482519724635_0006 2016-12-23 19:57:46,293 INFO [pool-8-thread-1] mapreduce.JobSubmitter:287 : Submitting tokens for job: job_1482519724635_0007 2016-12-23 19:57:47,427 INFO [pool-8-thread-2] impl.YarnClientImpl:274 : Submitted application application_1482519724635_0006 2016-12-23 19:57:47,429 INFO [pool-8-thread-1] impl.YarnClientImpl:274 : Submitted application application_1482519724635_0007 2016-12-23 19:57:47,586 INFO [pool-8-thread-1] mapreduce.Job:1294 : The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1482519724635_0007/ 2016-12-23 19:57:47,591 INFO [pool-8-thread-2] mapreduce.Job:1294 : The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1482519724635_0006/ 2016-12-23 19:57:47,688 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:57:47,691 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:57:47,765 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523049157, to newTs: 1482523067688, operation result: true 2016-12-23 19:57:47,815 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523049133, to newTs: 1482523067691, operation result: true 2016-12-23 19:57:51,609 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:57:57,799 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:57:57,814 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523067688, to newTs: 1482523077799, operation result: true 2016-12-23 19:57:57,837 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:57:57,884 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523067691, to newTs: 1482523077837, operation result: true 2016-12-23 19:58:07,833 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:58:07,845 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523077799, to newTs: 1482523087833, operation result: true 2016-12-23 19:58:07,918 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:58:07,968 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523077837, to newTs: 1482523087918, operation result: true 2016-12-23 19:58:17,868 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:58:17,889 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523087833, to newTs: 1482523097870, operation result: true 2016-12-23 19:58:18,171 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:58:18,392 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523087918, to newTs: 1482523098171, operation result: true 2016-12-23 19:58:28,210 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:58:28,252 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523097870, to newTs: 1482523108211, operation result: true 2016-12-23 19:58:28,410 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:58:28,419 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523098171, to newTs: 1482523108411, operation result: true 2016-12-23 19:58:29,526 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 2 should running, 2 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:58:39,456 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:58:39,463 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:58:40,073 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523108411, to newTs: 1482523119456, operation result: true 2016-12-23 19:58:40,091 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:58:40,157 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523119456, to newTs: 1482523120091, operation result: true 2016-12-23 19:58:40,157 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523108211, to newTs: 1482523119463, operation result: true 2016-12-23 19:58:40,162 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:58:40,181 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523119463, to newTs: 1482523120162, operation result: true 2016-12-23 19:58:55,280 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:58:58,424 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:58:58,834 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523120162, to newTs: 1482523135280, operation result: true 2016-12-23 19:58:58,934 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523120091, to newTs: 1482523138424, operation result: true 2016-12-23 19:59:09,099 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:59:09,111 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523138424, to newTs: 1482523149100, operation result: true 2016-12-23 19:59:09,116 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:59:09,122 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523135280, to newTs: 1482523149116, operation result: true 2016-12-23 19:59:19,536 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:59:19,544 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523149116, to newTs: 1482523159537, operation result: true 2016-12-23 19:59:19,551 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:59:19,602 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523149100, to newTs: 1482523159552, operation result: true 2016-12-23 19:59:23,314 DEBUG [http-bio-7070-exec-2] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 19:59:29,140 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 2 should running, 2 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 19:59:29,645 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:59:29,801 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523159552, to newTs: 1482523169645, operation result: true 2016-12-23 19:59:30,443 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:59:30,451 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523159537, to newTs: 1482523170443, operation result: true 2016-12-23 19:59:40,991 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:59:41,008 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523170443, to newTs: 1482523180992, operation result: true 2016-12-23 19:59:41,012 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:59:41,022 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523169645, to newTs: 1482523181012, operation result: true 2016-12-23 19:59:51,087 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 19:59:51,123 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 19:59:51,204 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523180992, to newTs: 1482523191088, operation result: true 2016-12-23 19:59:51,519 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523181012, to newTs: 1482523191123, operation result: true 2016-12-23 20:00:01,252 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:01,292 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523191088, to newTs: 1482523201252, operation result: true 2016-12-23 20:00:01,592 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:01,653 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523191123, to newTs: 1482523201592, operation result: true 2016-12-23 20:00:11,377 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:11,682 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523201252, to newTs: 1482523211377, operation result: true 2016-12-23 20:00:11,776 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:11,833 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523201592, to newTs: 1482523211777, operation result: true 2016-12-23 20:00:21,701 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:21,713 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523211377, to newTs: 1482523221701, operation result: true 2016-12-23 20:00:21,919 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:21,963 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523211777, to newTs: 1482523221919, operation result: true 2016-12-23 20:00:29,025 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 2 should running, 2 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:00:31,725 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:31,737 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523221701, to newTs: 1482523231725, operation result: true 2016-12-23 20:00:31,989 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:32,024 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523221919, to newTs: 1482523231989, operation result: true 2016-12-23 20:00:32,312 DEBUG [pool-8-thread-1] common.HadoopCmdOutput:94 : Counters: 49 File System Counters FILE: Number of bytes read=2308 FILE: Number of bytes written=484451 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=754369 HDFS: Number of bytes written=56 HDFS: Number of read operations=6 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 Job Counters Launched map tasks=1 Launched reduce tasks=1 Data-local map tasks=1 Total time spent by all maps in occupied slots (ms)=85331 Total time spent by all reduces in occupied slots (ms)=20789 Total time spent by all map tasks (ms)=85331 Total time spent by all reduce tasks (ms)=20789 Total vcore-seconds taken by all map tasks=85331 Total vcore-seconds taken by all reduce tasks=20789 Total megabyte-seconds taken by all map tasks=21332750 Total megabyte-seconds taken by all reduce tasks=5197250 Map-Reduce Framework Map input records=10000 Map output records=13 Map output bytes=4723 Map output materialized bytes=2300 Input split bytes=1843 Combine input records=0 Combine output records=0 Reduce input groups=13 Reduce shuffle bytes=2300 Reduce input records=13 Reduce output records=13 Spilled Records=26 Shuffled Maps =1 Failed Shuffles=0 Merged Map outputs=1 GC time elapsed (ms)=1662 CPU time spent (ms)=15430 Physical memory (bytes) snapshot=359940096 Virtual memory (bytes) snapshot=1709613056 Total committed heap usage (bytes)=266862592 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=0 File Output Format Counters Bytes Written=56 2016-12-23 20:00:32,313 DEBUG [pool-8-thread-2] common.HadoopCmdOutput:94 : Counters: 49 File System Counters FILE: Number of bytes read=8697 FILE: Number of bytes written=519149 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=517630 HDFS: Number of bytes written=274 HDFS: Number of read operations=6 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 Job Counters Launched map tasks=1 Launched reduce tasks=1 Data-local map tasks=1 Total time spent by all maps in occupied slots (ms)=85532 Total time spent by all reduces in occupied slots (ms)=21653 Total time spent by all map tasks (ms)=85532 Total time spent by all reduce tasks (ms)=21653 Total vcore-seconds taken by all map tasks=85532 Total vcore-seconds taken by all reduce tasks=21653 Total megabyte-seconds taken by all map tasks=21383000 Total megabyte-seconds taken by all reduce tasks=5413250 Map-Reduce Framework Map input records=731 Map output records=100 Map output bytes=22852 Map output materialized bytes=8689 Input split bytes=4633 Combine input records=0 Combine output records=0 Reduce input groups=100 Reduce shuffle bytes=8689 Reduce input records=100 Reduce output records=100 Spilled Records=200 Shuffled Maps =1 Failed Shuffles=0 Merged Map outputs=1 GC time elapsed (ms)=806 CPU time spent (ms)=13570 Physical memory (bytes) snapshot=364023808 Virtual memory (bytes) snapshot=1687146496 Total committed heap usage (bytes)=267911168 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=0 File Output Format Counters Bytes Written=274 2016-12-23 20:00:32,319 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:32,321 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:32,337 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523231989, to newTs: 1482523232319, operation result: true 2016-12-23 20:00:32,343 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523231725, to newTs: 1482523232322, operation result: true 2016-12-23 20:00:32,347 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:32,350 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:32,364 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523232322, to newTs: 1482523232350, operation result: true 2016-12-23 20:00:32,374 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523232319, to newTs: 1482523232348, operation result: true 2016-12-23 20:00:32,376 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-00 2016-12-23 20:00:32,441 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-00 from oldTs: 1482523232350, to newTs: 1482523232376, operation result: true 2016-12-23 20:00:32,442 INFO [pool-8-thread-2] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982-00 from RUNNING to SUCCEED 2016-12-23 20:00:32,442 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 2016-12-23 20:00:32,470 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from oldTs: 1482523232348, to newTs: 1482523232442, operation result: true 2016-12-23 20:00:32,470 INFO [pool-8-thread-1] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77-00 from RUNNING to SUCCEED 2016-12-23 20:00:32,476 DEBUG [pool-8-thread-2] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982 2016-12-23 20:00:32,496 DEBUG [pool-8-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 1482523049109, to newTs: 1482523232476, operation result: true 2016-12-23 20:00:32,496 INFO [pool-8-thread-2] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982 from RUNNING to READY 2016-12-23 20:00:32,508 DEBUG [pool-8-thread-1] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77 2016-12-23 20:00:32,518 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 1482523049084, to newTs: 1482523232509, operation result: true 2016-12-23 20:00:32,518 INFO [pool-8-thread-1] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from RUNNING to READY 2016-12-23 20:00:32,533 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : DefaultChainedExecutable{id=1f7a1236-43a9-4fb3-9d46-ba36d9128e77, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_SALES', state=READY} prepare to schedule 2016-12-23 20:00:32,533 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : DefaultChainedExecutable{id=1f7a1236-43a9-4fb3-9d46-ba36d9128e77, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_SALES', state=READY} scheduled 2016-12-23 20:00:32,537 INFO [pool-8-thread-3] execution.AbstractExecutable:99 : Executing AbstractExecutable (Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_SALES') 2016-12-23 20:00:32,552 DEBUG [pool-8-thread-3] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77 2016-12-23 20:00:32,552 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : DefaultChainedExecutable{id=f5956a79-c608-48a9-93e9-c3ccb166b982, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_CAL_DT', state=READY} prepare to schedule 2016-12-23 20:00:32,552 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : DefaultChainedExecutable{id=f5956a79-c608-48a9-93e9-c3ccb166b982, name=Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_CAL_DT', state=READY} scheduled 2016-12-23 20:00:32,552 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 2 actual running, 2 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:00:32,552 INFO [pool-8-thread-4] execution.AbstractExecutable:99 : Executing AbstractExecutable (Hive Column Cardinality calculation for table 'DEFAULT.KYLIN_CAL_DT') 2016-12-23 20:00:32,561 DEBUG [pool-8-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 1482523232509, to newTs: 1482523232552, operation result: true 2016-12-23 20:00:32,561 INFO [pool-8-thread-3] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from READY to RUNNING 2016-12-23 20:00:32,566 DEBUG [pool-8-thread-4] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982 2016-12-23 20:00:32,570 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 2 should running, 2 actual running, 0 ready, 0 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:00:32,587 DEBUG [pool-8-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 1482523232476, to newTs: 1482523232566, operation result: true 2016-12-23 20:00:32,588 INFO [pool-8-thread-4] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982 from READY to RUNNING 2016-12-23 20:00:32,596 INFO [pool-8-thread-3] execution.AbstractExecutable:99 : Executing AbstractExecutable (null) 2016-12-23 20:00:32,601 DEBUG [pool-8-thread-3] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 2016-12-23 20:00:32,614 INFO [pool-8-thread-4] execution.AbstractExecutable:99 : Executing AbstractExecutable (null) 2016-12-23 20:00:32,616 DEBUG [pool-8-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 from oldTs: 1482522989828, to newTs: 1482523232602, operation result: true 2016-12-23 20:00:32,617 INFO [pool-8-thread-3] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 from READY to RUNNING 2016-12-23 20:00:32,618 DEBUG [pool-8-thread-4] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-01 2016-12-23 20:00:32,634 DEBUG [pool-8-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-01 from oldTs: 1482522989785, to newTs: 1482523232618, operation result: true 2016-12-23 20:00:32,634 INFO [pool-8-thread-4] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982-01 from READY to RUNNING 2016-12-23 20:00:32,727 INFO [pool-8-thread-3] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable: 2016-12-23 20:00:32,727 INFO [pool-8-thread-3] common.HadoopShellExecutable:59 : -table DEFAULT.KYLIN_SALES -output /tmp/kylin/cardinality/DEFAULT.KYLIN_SALES 2016-12-23 20:00:32,733 INFO [pool-8-thread-3] cardinality.HiveColumnCardinalityUpdateJob:80 : Starting: Kylin Hive Column Cardinality Update Job table=DEFAULT.KYLIN_SALES output=/tmp/kylin/cardinality/DEFAULT.KYLIN_SALES 2016-12-23 20:00:32,791 INFO [pool-8-thread-4] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable: 2016-12-23 20:00:32,795 INFO [pool-8-thread-4] common.HadoopShellExecutable:59 : -table DEFAULT.KYLIN_CAL_DT -output /tmp/kylin/cardinality/DEFAULT.KYLIN_CAL_DT 2016-12-23 20:00:32,796 INFO [pool-8-thread-4] cardinality.HiveColumnCardinalityUpdateJob:80 : Starting: Kylin Hive Column Cardinality Update Job table=DEFAULT.KYLIN_CAL_DT output=/tmp/kylin/cardinality/DEFAULT.KYLIN_CAL_DT 2016-12-23 20:00:32,899 INFO [pool-8-thread-3] zlib.ZlibFactory:49 : Successfully loaded & initialized native-zlib library 2016-12-23 20:00:32,902 INFO [pool-8-thread-3] compress.CodecPool:181 : Got brand-new decompressor [.deflate] 2016-12-23 20:00:32,902 INFO [pool-8-thread-4] compress.CodecPool:181 : Got brand-new decompressor [.deflate] 2016-12-23 20:00:33,147 DEBUG [pool-8-thread-4] persistence.ResourceStore:207 : Directly saving resource /table_exd/DEFAULT.KYLIN_CAL_DT.json (Store kylin_metadata@hbase) 2016-12-23 20:00:33,151 DEBUG [pool-8-thread-3] persistence.ResourceStore:207 : Directly saving resource /table_exd/DEFAULT.KYLIN_SALES.json (Store kylin_metadata@hbase) 2016-12-23 20:00:33,159 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=table_ext, event=update, cacheKey=DEFAULT.KYLIN_CAL_DT} 2016-12-23 20:00:33,162 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=table_ext, event=update, cacheKey=DEFAULT.KYLIN_SALES} 2016-12-23 20:00:33,168 DEBUG [pool-8-thread-3] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 2016-12-23 20:00:33,169 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=table_ext, event=UPDATE, cacheKey=DEFAULT.KYLIN_CAL_DT, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc] 2016-12-23 20:00:33,172 DEBUG [pool-8-thread-4] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-01 2016-12-23 20:00:33,197 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:00:33,213 DEBUG [pool-8-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 from oldTs: 1482523232602, to newTs: 1482523233168, operation result: true 2016-12-23 20:00:33,216 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 20:00:33,218 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 20:00:33,226 DEBUG [pool-8-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-01 from oldTs: 1482523232618, to newTs: 1482523233173, operation result: true 2016-12-23 20:00:33,243 DEBUG [pool-8-thread-4] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982-01 2016-12-23 20:00:33,245 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 20:00:33,246 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:00:33,246 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:00:33,246 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:00:33,247 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:00:33,247 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 20:00:33,247 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 20:00:33,248 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 20:00:33,248 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial 2016-12-23 20:00:33,248 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=table_ext, event=UPDATE, cacheKey=DEFAULT.KYLIN_CAL_DT 2016-12-23 20:00:33,272 DEBUG [pool-8-thread-3] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 2016-12-23 20:00:33,287 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=table_ext, event=UPDATE, cacheKey=DEFAULT.KYLIN_SALES, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc] 2016-12-23 20:00:33,335 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:00:33,338 DEBUG [pool-8-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982-01 from oldTs: 1482523233173, to newTs: 1482523233243, operation result: true 2016-12-23 20:00:33,339 INFO [pool-8-thread-4] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982-01 from RUNNING to SUCCEED 2016-12-23 20:00:33,356 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 20:00:33,357 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 20:00:33,390 DEBUG [pool-8-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 from oldTs: 1482523233168, to newTs: 1482523233274, operation result: true 2016-12-23 20:00:33,390 INFO [pool-8-thread-3] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77-01 from RUNNING to SUCCEED 2016-12-23 20:00:33,400 DEBUG [pool-8-thread-4] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982 2016-12-23 20:00:33,427 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 0 segments 2016-12-23 20:00:33,428 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:00:33,428 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:00:33,428 DEBUG [pool-8-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 1482523232566, to newTs: 1482523233401, operation result: true 2016-12-23 20:00:33,433 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:00:33,434 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:00:33,434 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 20:00:33,434 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 20:00:33,436 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 20:00:33,436 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial 2016-12-23 20:00:33,437 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=table_ext, event=UPDATE, cacheKey=DEFAULT.KYLIN_SALES 2016-12-23 20:00:33,442 DEBUG [pool-8-thread-4] dao.ExecutableDao:210 : updating job output, id: f5956a79-c608-48a9-93e9-c3ccb166b982 2016-12-23 20:00:33,456 DEBUG [pool-8-thread-3] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77 2016-12-23 20:00:33,497 DEBUG [pool-8-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f5956a79-c608-48a9-93e9-c3ccb166b982 from oldTs: 1482523233401, to newTs: 1482523233450, operation result: true 2016-12-23 20:00:33,497 INFO [pool-8-thread-4] manager.ExecutableManager:292 : job id:f5956a79-c608-48a9-93e9-c3ccb166b982 from RUNNING to SUCCEED 2016-12-23 20:00:33,497 WARN [pool-8-thread-4] execution.AbstractExecutable:247 : no need to send email, user list is empty 2016-12-23 20:00:33,503 DEBUG [pool-8-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 1482523232552, to newTs: 1482523233456, operation result: true 2016-12-23 20:00:33,510 DEBUG [pool-8-thread-3] dao.ExecutableDao:210 : updating job output, id: 1f7a1236-43a9-4fb3-9d46-ba36d9128e77 2016-12-23 20:00:33,537 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 1 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:00:33,555 DEBUG [pool-8-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from oldTs: 1482523233456, to newTs: 1482523233510, operation result: true 2016-12-23 20:00:33,556 INFO [pool-8-thread-3] manager.ExecutableManager:292 : job id:1f7a1236-43a9-4fb3-9d46-ba36d9128e77 from RUNNING to SUCCEED 2016-12-23 20:00:33,556 WARN [pool-8-thread-3] execution.AbstractExecutable:247 : no need to send email, user list is empty 2016-12-23 20:00:33,601 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:01:29,055 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:02:29,027 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:03:29,009 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:04:29,009 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:04:40,734 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:05:29,019 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:06:02,960 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:06:25,676 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:06:29,009 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:07:29,015 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:07:34,040 DEBUG [http-bio-7070-exec-2] controller.ModelController:197 : Saving MODEL { "name": "Tutorial_Model", "description": "", "fact_table": "DEFAULT.KYLIN_SALES", "lookups": [ { "table": "DEFAULT.KYLIN_CAL_DT", "join": { "type": "inner", "primary_key": [ "CAL_DT" ], "foreign_key": [ "PART_DT" ], "isCompatible": [ true ], "pk_type": [ "date" ], "fk_type": [ "date" ] } } ], "filter_condition": "price>0", "dimensions": [ { "table": "DEFAULT.KYLIN_SALES", "columns": [ "TRANS_ID", "LSTG_SITE_ID", "SELLER_ID", "LSTG_FORMAT_NAME", "LEAF_CATEG_ID", "SLR_SEGMENT_CD" ] }, { "table": "DEFAULT.KYLIN_CAL_DT", "columns": [ "YEAR_BEG_DT", "MONTH_BEG_DT", "QTR_BEG_DT", "WEEK_BEG_DT" ] } ], "metrics": [ "PRICE", "ITEM_COUNT", "SELLER_ID" ], "partition_desc": { "partition_date_column": "DEFAULT.KYLIN_SALES.PART_DT", "partition_date_start": null, "partition_type": "APPEND", "partition_date_format": "yyyy-MM-dd", "partition_time_column": null, "partition_time_start": null }, "last_modified": 0 } 2016-12-23 20:07:34,102 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /model_desc/Tutorial_Model.json from oldTs: 0, to newTs: 1482523654046, operation result: true 2016-12-23 20:07:34,105 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=data_model, event=create, cacheKey=Tutorial_Model} 2016-12-23 20:07:34,151 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /project/Tutorial.json from oldTs: 1482522989837, to newTs: 1482523654105, operation result: true 2016-12-23 20:07:34,153 DEBUG [http-bio-7070-exec-8] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=data_model, event=CREATE, cacheKey=Tutorial_Model, listeners=[org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8] 2016-12-23 20:07:34,153 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=project, event=update, cacheKey=Tutorial} 2016-12-23 20:07:34,173 DEBUG [http-bio-7070-exec-8] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:07:34,211 INFO [http-bio-7070-exec-8] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 20:07:34,212 INFO [http-bio-7070-exec-8] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 20:07:34,212 INFO [http-bio-7070-exec-8] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 20:07:34,213 DEBUG [http-bio-7070-exec-8] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial 2016-12-23 20:07:34,213 DEBUG [http-bio-7070-exec-8] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=data_model, event=CREATE, cacheKey=Tutorial_Model 2016-12-23 20:07:34,236 DEBUG [http-bio-7070-exec-2] service.AclService:240 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: eba8b4de-11c0-4ba9-9902-afd81e5199b8] created successfully. 2016-12-23 20:07:34,244 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41] 2016-12-23 20:07:34,263 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:07:34,287 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 20:07:34,287 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 20:07:34,288 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 20:07:34,288 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_schema, event=UPDATE, cacheKey=Tutorial 2016-12-23 20:07:34,289 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=Tutorial, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:07:34,289 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project Tutorial 2016-12-23 20:07:34,290 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectTutorial (currently remove all entries) 2016-12-23 20:07:34,291 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=Tutorial 2016-12-23 20:07:34,291 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project, event=UPDATE, cacheKey=Tutorial 2016-12-23 20:07:34,351 DEBUG [http-bio-7070-exec-2] service.AclService:307 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: eba8b4de-11c0-4ba9-9902-afd81e5199b8] updated successfully. 2016-12-23 20:07:34,655 DEBUG [http-bio-7070-exec-2] service.AclService:307 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: eba8b4de-11c0-4ba9-9902-afd81e5199b8] updated successfully. 2016-12-23 20:07:35,629 DEBUG [http-bio-7070-exec-2] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:07:37,720 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:07:37,773 DEBUG [http-bio-7070-exec-9] service.AdminService:88 : Get Kylin Runtime Config 2016-12-23 20:07:38,257 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:07:38,432 INFO [http-bio-7070-exec-3] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 20:07:38,433 INFO [http-bio-7070-exec-3] controller.TableController:108 : Return all table metadata in 1 seconds 2016-12-23 20:07:48,447 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:08:04,083 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:08:04,122 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:08:29,012 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:09:02,235 DEBUG [http-bio-7070-exec-2] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:09:29,028 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:10:29,008 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:11:29,052 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:12:05,583 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:12:29,010 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:12:50,261 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:13:17,285 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:13:29,020 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:13:29,154 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:13:33,571 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:13:40,941 DEBUG [http-bio-7070-exec-6] controller.CubeController:653 : Saving cube { "name": "Tutorial_Cube", "model_name": "Tutorial_Model", "description": "", "dimensions": [ { "name": "NAME", "table": "DEFAULT.KYLIN_SALES", "derived": null, "column": "LSTG_FORMAT_NAME" } ], "measures": [ { "name": "_COUNT_", "function": { "expression": "COUNT", "returntype": "bigint", "parameter": { "type": "constant", "value": "1", "next_parameter": null }, "configuration": {} } }, { "name": "total_price", "function": { "expression": "SUM", "returntype": "decimal(19,4)", "parameter": { "type": "column", "value": "PRICE", "next_parameter": null }, "configuration": null } } ], "dictionaries": [], "rowkey": { "rowkey_columns": [ { "column": "LSTG_FORMAT_NAME", "encoding": "dict", "isShardBy": "false" } ] }, "aggregation_groups": [ { "includes": [ "LSTG_FORMAT_NAME" ], "select_rule": { "hierarchy_dims": [], "mandatory_dims": [], "joint_dims": [] } } ], "partition_date_start": "2011-12-31", "notify_list": [], "hbase_mapping": { "column_family": [ { "name": "f1", "columns": [ { "qualifier": "m", "measure_refs": [ "_COUNT_", "total_price" ] } ] } ] }, "retention_range": 15552000000, "status_need_notify": [ "ERROR", "DISCARDED", "SUCCEED" ], "auto_merge_time_ranges": [ 604800000, 2419200000 ], "engine_type": 2, "storage_type": 2, "override_kylin_properties": {} } 2016-12-23 20:13:41,016 ERROR [http-bio-7070-exec-6] controller.CubeController:659 : The cube definition is not valid. com.fasterxml.jackson.databind.exc.InvalidFormatException: Can not construct instance of long from String value '2011-12-31': not a valid Long value at [Source: { "name": "Tutorial_Cube", "model_name": "Tutorial_Model", "description": "", "dimensions": [ { "name": "NAME", "table": "DEFAULT.KYLIN_SALES", "derived": null, "column": "LSTG_FORMAT_NAME" } ], "measures": [ { "name": "_COUNT_", "function": { "expression": "COUNT", "returntype": "bigint", "parameter": { "type": "constant", "value": "1", "next_parameter": null }, "configuration": {} } }, { "name": "total_price", "function": { "expression": "SUM", "returntype": "decimal(19,4)", "parameter": { "type": "column", "value": "PRICE", "next_parameter": null }, "configuration": null } } ], "dictionaries": [], "rowkey": { "rowkey_columns": [ { "column": "LSTG_FORMAT_NAME", "encoding": "dict", "isShardBy": "false" } ] }, "aggregation_groups": [ { "includes": [ "LSTG_FORMAT_NAME" ], "select_rule": { "hierarchy_dims": [], "mandatory_dims": [], "joint_dims": [] } } ], "partition_date_start": "2011-12-31", "notify_list": [], "hbase_mapping": { "column_family": [ { "name": "f1", "columns": [ { "qualifier": "m", "measure_refs": [ "_COUNT_", "total_price" ] } ] } ] }, "retention_range": 15552000000, "status_need_notify": [ "ERROR", "DISCARDED", "SUCCEED" ], "auto_merge_time_ranges": [ 604800000, 2419200000 ], "engine_type": 2, "storage_type": 2, "override_kylin_properties": {} }; line: 62, column: 4] (through reference chain: org.apache.kylin.cube.model.CubeDesc["partition_date_start"]) at com.fasterxml.jackson.databind.exc.InvalidFormatException.from(InvalidFormatException.java:55) at com.fasterxml.jackson.databind.DeserializationContext.weirdStringException(DeserializationContext.java:907) at com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseLong(StdDeserializer.java:487) at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$LongDeserializer.deserialize(NumberDeserializers.java:347) at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$LongDeserializer.deserialize(NumberDeserializers.java:325) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:520) at com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:101) at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:258) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:125) at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3736) at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2726) at org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:54) at org.apache.kylin.rest.controller.CubeController.deserializeCubeDesc(CubeController.java:654) at org.apache.kylin.rest.controller.CubeController.saveCubeDesc(CubeController.java:416) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:853) at javax.servlet.http.HttpServlet.service(HttpServlet.java:650) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827) at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:318) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-12-23 20:14:29,052 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:15:29,008 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:16:29,012 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:17:29,030 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:18:29,042 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:19:29,012 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:20:29,045 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:21:29,038 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:22:29,011 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:23:29,036 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:24:29,149 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:25:29,079 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:26:29,180 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:27:02,312 INFO [http-bio-7070-exec-8] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 20:27:02,313 WARN [http-bio-7070-exec-8] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 20:27:02,314 INFO [http-bio-7070-exec-8] controller.TableController:108 : Return all table metadata in 2 seconds 2016-12-23 20:27:14,124 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:14,225 DEBUG [http-bio-7070-exec-5] service.CacheService:158 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-12-23 20:27:14,256 INFO [http-bio-7070-exec-5] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "", "schemas": [ ] } 2016-12-23 20:27:14,257 DEBUG [http-bio-7070-exec-5] service.CacheService:163 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "", "schemas": [ ] } 2016-12-23 20:27:17,113 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:17,211 DEBUG [http-bio-7070-exec-5] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-12-23 20:27:20,129 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:29,032 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:27:34,267 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:34,420 DEBUG [http-bio-7070-exec-9] service.AdminService:88 : Get Kylin Runtime Config 2016-12-23 20:27:34,889 DEBUG [http-bio-7070-exec-1] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:34,905 DEBUG [http-bio-7070-exec-6] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:34,910 DEBUG [http-bio-7070-exec-3] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:27:35,048 INFO [http-bio-7070-exec-10] controller.TableController:108 : Return all table metadata in 0 seconds 2016-12-23 20:28:04,672 DEBUG [http-bio-7070-exec-2] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:28:24,594 ERROR [http-bio-7070-exec-7] controller.BasicController:44 : org.springframework.http.converter.HttpMessageNotReadableException: Could not read JSON: Can not construct instance of long from String value '2014-02-01': not a valid Long value at [Source: org.apache.catalina.connector.CoyoteInputStream@2f3957dd; line: 1, column: 47] (through reference chain: org.apache.kylin.rest.request.JobBuildRequest["endTime"]); nested exception is com.fasterxml.jackson.databind.exc.InvalidFormatException: Can not construct instance of long from String value '2014-02-01': not a valid Long value at [Source: org.apache.catalina.connector.CoyoteInputStream@2f3957dd; line: 1, column: 47] (through reference chain: org.apache.kylin.rest.request.JobBuildRequest["endTime"]) at org.springframework.http.converter.json.MappingJackson2HttpMessageConverter.readJavaType(MappingJackson2HttpMessageConverter.java:181) at org.springframework.http.converter.json.MappingJackson2HttpMessageConverter.read(MappingJackson2HttpMessageConverter.java:173) at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodArgumentResolver.readWithMessageConverters(AbstractMessageConverterMethodArgumentResolver.java:143) at org.springframework.web.servlet.mvc.method.annotation.RequestResponseBodyMethodProcessor.readWithMessageConverters(RequestResponseBodyMethodProcessor.java:179) at org.springframework.web.servlet.mvc.method.annotation.RequestResponseBodyMethodProcessor.resolveArgument(RequestResponseBodyMethodProcessor.java:92) at org.springframework.web.method.support.HandlerMethodArgumentResolverComposite.resolveArgument(HandlerMethodArgumentResolverComposite.java:77) at org.springframework.web.method.support.InvocableHandlerMethod.getMethodArgumentValues(InvocableHandlerMethod.java:161) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:128) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951) at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:864) at javax.servlet.http.HttpServlet.service(HttpServlet.java:653) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827) at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:318) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: com.fasterxml.jackson.databind.exc.InvalidFormatException: Can not construct instance of long from String value '2014-02-01': not a valid Long value at [Source: org.apache.catalina.connector.CoyoteInputStream@2f3957dd; line: 1, column: 47] (through reference chain: org.apache.kylin.rest.request.JobBuildRequest["endTime"]) at com.fasterxml.jackson.databind.exc.InvalidFormatException.from(InvalidFormatException.java:55) at com.fasterxml.jackson.databind.DeserializationContext.weirdStringException(DeserializationContext.java:907) at com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseLong(StdDeserializer.java:487) at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$LongDeserializer.deserialize(NumberDeserializers.java:347) at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$LongDeserializer.deserialize(NumberDeserializers.java:325) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:520) at com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:95) at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:258) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:125) at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3736) at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2810) at org.springframework.http.converter.json.MappingJackson2HttpMessageConverter.readJavaType(MappingJackson2HttpMessageConverter.java:178) ... 72 more 2016-12-23 20:28:29,010 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:28:50,245 DEBUG [http-bio-7070-exec-5] service.AdminService:88 : Get Kylin Runtime Config 2016-12-23 20:28:50,267 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:28:50,620 DEBUG [http-bio-7070-exec-2] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:28:50,835 INFO [http-bio-7070-exec-8] controller.TableController:108 : Return all table metadata in 1 seconds 2016-12-23 20:29:09,484 INFO [http-bio-7070-exec-10] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:29:09,490 WARN [http-bio-7070-exec-10] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:29:09,491 WARN [http-bio-7070-exec-10] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:29:09,532 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482521623000, to newTs: 1482524949491, operation result: true 2016-12-23 20:29:09,532 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:29:09,600 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:29:09,614 INFO [http-bio-7070-exec-2] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:29:09,616 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:29:09,616 INFO [http-bio-7070-exec-2] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:29:09,617 INFO [http-bio-7070-exec-2] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:29:09,617 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:29:09,621 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:29:09,645 INFO [http-bio-7070-exec-10] mr.BatchCubingJobBuilder2:51 : MR_V2 new job to BUILD segment kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:29:09,732 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,940 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,943 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,945 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,945 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,946 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,947 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,948 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,948 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,949 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,950 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf_inmem.xml 2016-12-23 20:29:09,952 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:95 : Chosen job conf is : /database/install/kylin/conf/kylin_job_conf.xml 2016-12-23 20:29:09,996 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 0, to newTs: 1482524949965, operation result: true 2016-12-23 20:29:10,015 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 0, to newTs: 1482524949996, operation result: true 2016-12-23 20:29:10,053 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-00 from oldTs: 0, to newTs: 1482524950016, operation result: true 2016-12-23 20:29:10,071 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-01 from oldTs: 0, to newTs: 1482524950054, operation result: true 2016-12-23 20:29:10,114 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 0, to newTs: 1482524950072, operation result: true 2016-12-23 20:29:10,123 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-03 from oldTs: 0, to newTs: 1482524950114, operation result: true 2016-12-23 20:29:10,135 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-04 from oldTs: 0, to newTs: 1482524950123, operation result: true 2016-12-23 20:29:10,150 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-05 from oldTs: 0, to newTs: 1482524950135, operation result: true 2016-12-23 20:29:10,162 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-06 from oldTs: 0, to newTs: 1482524950151, operation result: true 2016-12-23 20:29:10,173 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-07 from oldTs: 0, to newTs: 1482524950163, operation result: true 2016-12-23 20:29:10,193 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-08 from oldTs: 0, to newTs: 1482524950174, operation result: true 2016-12-23 20:29:10,200 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-09 from oldTs: 0, to newTs: 1482524950193, operation result: true 2016-12-23 20:29:10,230 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-10 from oldTs: 0, to newTs: 1482524950201, operation result: true 2016-12-23 20:29:10,246 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-11 from oldTs: 0, to newTs: 1482524950231, operation result: true 2016-12-23 20:29:10,258 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-12 from oldTs: 0, to newTs: 1482524950247, operation result: true 2016-12-23 20:29:10,275 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-13 from oldTs: 0, to newTs: 1482524950259, operation result: true 2016-12-23 20:29:10,290 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-14 from oldTs: 0, to newTs: 1482524950276, operation result: true 2016-12-23 20:29:10,317 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-15 from oldTs: 0, to newTs: 1482524950290, operation result: true 2016-12-23 20:29:10,331 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-16 from oldTs: 0, to newTs: 1482524950318, operation result: true 2016-12-23 20:29:10,350 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-17 from oldTs: 0, to newTs: 1482524950331, operation result: true 2016-12-23 20:29:10,367 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-18 from oldTs: 0, to newTs: 1482524950350, operation result: true 2016-12-23 20:29:10,376 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-19 from oldTs: 0, to newTs: 1482524950367, operation result: true 2016-12-23 20:29:10,583 DEBUG [http-bio-7070-exec-10] service.AclService:240 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.job.JobInstance; Identifier: e32d3530-54b0-486a-96a3-024208cf6402] created successfully. 2016-12-23 20:29:10,629 DEBUG [http-bio-7070-exec-10] service.AclService:240 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.cube.CubeInstance; Identifier: 2fbca32a-a33e-4b69-83dd-0bb8b1f8c53b] created successfully. 2016-12-23 20:29:10,668 DEBUG [http-bio-7070-exec-10] service.AclService:307 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.job.JobInstance; Identifier: e32d3530-54b0-486a-96a3-024208cf6402] updated successfully. 2016-12-23 20:29:18,881 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:18,940 DEBUG [http-bio-7070-exec-4] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-12-23 20:29:29,076 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:29:29,077 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:29:29,077 INFO [pool-8-thread-5] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:29:29,090 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:29:29,099 DEBUG [pool-8-thread-5] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:29:29,111 DEBUG [pool-8-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482524949996, to newTs: 1482524969100, operation result: true 2016-12-23 20:29:29,111 INFO [pool-8-thread-5] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:29:29,124 INFO [pool-8-thread-5] execution.AbstractExecutable:99 : Executing AbstractExecutable (Create Intermediate Flat Hive Table) 2016-12-23 20:29:29,135 DEBUG [pool-8-thread-5] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-00 2016-12-23 20:29:29,164 DEBUG [pool-8-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-00 from oldTs: 1482524950016, to newTs: 1482524969135, operation result: true 2016-12-23 20:29:29,165 INFO [pool-8-thread-5] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-00 from READY to RUNNING 2016-12-23 20:29:29,168 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Create and distribute table, cmd: 2016-12-23 20:29:29,168 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : hive -e "SET dfs.replication=2; SET hive.exec.compress.output=true; SET hive.auto.convert.join.noconditionaltask=true; SET hive.auto.convert.join.noconditionaltask.size=100000000; SET mapreduce.output.fileoutputformat.compress.type=BLOCK; SET mapreduce.job.split.metainfo.maxsize=-1; USE default; DROP TABLE IF EXISTS kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6; CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 ( DEFAULT_KYLIN_SALES_PART_DT date ,DEFAULT_KYLIN_SALES_LEAF_CATEG_ID bigint ,DEFAULT_KYLIN_SALES_LSTG_SITE_ID int ,DEFAULT_KYLIN_CATEGORY_GROUPINGS_META_CATEG_NAME string ,DEFAULT_KYLIN_CATEGORY_GROUPINGS_CATEG_LVL2_NAME string ,DEFAULT_KYLIN_CATEGORY_GROUPINGS_CATEG_LVL3_NAME string ,DEFAULT_KYLIN_SALES_LSTG_FORMAT_NAME string ,DEFAULT_KYLIN_SALES_USER_ID string ,DEFAULT_KYLIN_SALES_REGION string ,DEFAULT_KYLIN_SALES_PRICE decimal(19,4) ,DEFAULT_KYLIN_SALES_SELLER_ID bigint ) STORED AS SEQUENCEFILE LOCATION '/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6'; SET dfs.replication=2; SET hive.exec.compress.output=true; SET hive.auto.convert.join.noconditionaltask=true; SET hive.auto.convert.join.noconditionaltask.size=100000000; SET mapreduce.output.fileoutputformat.compress.type=BLOCK; SET mapreduce.job.split.metainfo.maxsize=-1; INSERT OVERWRITE TABLE kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 SELECT KYLIN_SALES.PART_DT ,KYLIN_SALES.LEAF_CATEG_ID ,KYLIN_SALES.LSTG_SITE_ID ,KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME ,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME ,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME ,KYLIN_SALES.LSTG_FORMAT_NAME ,KYLIN_SALES.USER_ID ,KYLIN_SALES.REGION ,KYLIN_SALES.PRICE ,KYLIN_SALES.SELLER_ID FROM DEFAULT.KYLIN_SALES as KYLIN_SALES INNER JOIN DEFAULT.KYLIN_CATEGORY_GROUPINGS as KYLIN_CATEGORY_GROUPINGS ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID AND KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID WHERE (KYLIN_SALES.PART_DT >= '2012-01-01' AND KYLIN_SALES.PART_DT < '2016-12-01') ; " 2016-12-23 20:29:35,738 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:38,252 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:38,519 DEBUG [http-bio-7070-exec-8] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-12-23 20:29:44,090 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : WARNING: Use "yarn jar" to launch YARN applications. 2016-12-23 20:29:44,793 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:52,062 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : 2016-12-23 20:29:52,063 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Logging initialized using configuration in file:/etc/hive/2.4.0.0-169/0/hive-log4j.properties 2016-12-23 20:29:56,378 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:56,414 DEBUG [http-bio-7070-exec-7] service.AdminService:88 : Get Kylin Runtime Config 2016-12-23 20:29:56,907 DEBUG [http-bio-7070-exec-1] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:57,221 DEBUG [http-bio-7070-exec-10] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:57,224 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:29:57,496 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:174 : Loading L2 project cache for LEARN_KYLIN 2016-12-23 20:29:57,497 WARN [http-bio-7070-exec-5] realization.RealizationRegistry:120 : No provider for realization type INVERTED_INDEX 2016-12-23 20:29:57,499 INFO [http-bio-7070-exec-5] controller.TableController:108 : Return all table metadata in 3 seconds 2016-12-23 20:30:29,103 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:30:44,952 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : OK 2016-12-23 20:30:44,955 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Time taken: 5.298 seconds 2016-12-23 20:30:50,866 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : OK 2016-12-23 20:30:50,868 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Time taken: 5.912 seconds 2016-12-23 20:31:03,201 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : OK 2016-12-23 20:31:03,331 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Time taken: 12.458 seconds 2016-12-23 20:31:09,607 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Query ID = root_20161223203103_32801b94-e5c9-4bfd-8079-c633cc0fb731 2016-12-23 20:31:09,608 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Total jobs = 1 2016-12-23 20:31:10,007 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Launching Job 1 out of 1 2016-12-23 20:31:13,792 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : 2016-12-23 20:31:13,793 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : 2016-12-23 20:31:15,093 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Status: Running (Executing on YARN cluster with App id application_1482519724635_0008) 2016-12-23 20:31:15,093 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : 2016-12-23 20:31:15,095 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: -/- Map 2: -/- 2016-12-23 20:31:15,425 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: -/- Map 2: 0/1 2016-12-23 20:31:15,635 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0/1 Map 2: 0/1 2016-12-23 20:31:18,856 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0/1 Map 2: 0/1 2016-12-23 20:31:22,008 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0/1 Map 2: 0/1 2016-12-23 20:31:24,933 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:28,021 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:29,125 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:31:31,201 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:35,322 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:39,126 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:42,180 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:45,309 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 0(+1)/1 2016-12-23 20:31:46,961 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 1/1 2016-12-23 20:31:50,051 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 1/1 2016-12-23 20:31:53,059 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 0(+1)/1 Map 2: 1/1 2016-12-23 20:31:56,478 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Map 1: 1/1 Map 2: 1/1 2016-12-23 20:31:57,200 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Loading data to table default.kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 2016-12-23 20:32:00,756 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Table default.kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 stats: [numFiles=1, numRows=10000, totalSize=189044, rawDataSize=1104046] 2016-12-23 20:32:09,849 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : OK 2016-12-23 20:32:09,921 INFO [pool-8-thread-5] hive.CreateFlatHiveTableStep:36 : Time taken: 66.541 seconds 2016-12-23 20:32:10,499 DEBUG [pool-8-thread-5] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-00 2016-12-23 20:32:10,508 DEBUG [pool-8-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-00 from oldTs: 1482524969135, to newTs: 1482525130499, operation result: true 2016-12-23 20:32:10,516 DEBUG [pool-8-thread-5] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-00 2016-12-23 20:32:10,531 DEBUG [pool-8-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-00 from oldTs: 1482525130499, to newTs: 1482525130516, operation result: true 2016-12-23 20:32:10,531 INFO [pool-8-thread-5] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-00 from RUNNING to SUCCEED 2016-12-23 20:32:10,542 DEBUG [pool-8-thread-5] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:32:10,553 DEBUG [pool-8-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482524969100, to newTs: 1482525130543, operation result: true 2016-12-23 20:32:10,861 DEBUG [pool-8-thread-5] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:32:10,910 DEBUG [pool-8-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525130543, to newTs: 1482525130861, operation result: true 2016-12-23 20:32:10,910 INFO [pool-8-thread-5] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from RUNNING to READY 2016-12-23 20:32:10,975 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:32:10,978 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:32:10,978 INFO [pool-8-thread-6] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:32:10,985 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:32:10,991 DEBUG [pool-8-thread-6] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:32:11,000 DEBUG [pool-8-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525130861, to newTs: 1482525130992, operation result: true 2016-12-23 20:32:11,001 INFO [pool-8-thread-6] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:32:11,020 INFO [pool-8-thread-6] execution.AbstractExecutable:99 : Executing AbstractExecutable (Redistribute Flat Hive Table) 2016-12-23 20:32:11,027 DEBUG [pool-8-thread-6] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-01 2016-12-23 20:32:11,036 DEBUG [pool-8-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-01 from oldTs: 1482524950054, to newTs: 1482525131027, operation result: true 2016-12-23 20:32:11,036 INFO [pool-8-thread-6] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-01 from READY to RUNNING 2016-12-23 20:32:11,037 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Compute row count of flat hive table, cmd: 2016-12-23 20:32:11,037 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : hive -e "USE default; SET dfs.replication=2; SET hive.exec.compress.output=true; SET hive.auto.convert.join.noconditionaltask=true; SET hive.auto.convert.join.noconditionaltask.size=100000000; SET mapreduce.output.fileoutputformat.compress.type=BLOCK; SET mapreduce.job.split.metainfo.maxsize=-1; set hive.exec.compress.output=false; set hive.exec.compress.output=false; INSERT OVERWRITE DIRECTORY '/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/row_count' SELECT count(*) FROM kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6; " 2016-12-23 20:32:22,334 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : WARNING: Use "yarn jar" to launch YARN applications. 2016-12-23 20:32:27,784 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:32:27,784 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Logging initialized using configuration in file:/etc/hive/2.4.0.0-169/0/hive-log4j.properties 2016-12-23 20:32:29,042 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:33:06,155 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : OK 2016-12-23 20:33:06,163 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Time taken: 11.096 seconds 2016-12-23 20:33:07,867 INFO [http-bio-7070-exec-6] project.ProjectL2Cache:174 : Loading L2 project cache for TUTORIAL 2016-12-23 20:33:07,868 INFO [http-bio-7070-exec-6] controller.TableController:108 : Return all table metadata in 1 seconds 2016-12-23 20:33:18,206 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Query ID = root_20161223203306_4b6feeed-4ca8-4462-a280-dc3e8ae2a775 2016-12-23 20:33:18,206 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Total jobs = 1 2016-12-23 20:33:18,376 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Launching Job 1 out of 1 2016-12-23 20:33:22,878 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:33:22,879 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:33:27,120 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Status: Running (Executing on YARN cluster with App id application_1482519724635_0009) 2016-12-23 20:33:27,120 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:33:27,121 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: -/- Reducer 2: 0/1 2016-12-23 20:33:27,914 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:33:28,317 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:33:29,175 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:33:31,554 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:33:34,619 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:33:37,602 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:33:40,871 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:33:42,467 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:33:45,662 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:33:48,967 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:33:50,951 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:33:51,494 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 0/1 2016-12-23 20:33:52,505 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 0(+1)/1 2016-12-23 20:33:55,956 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 0(+1)/1 2016-12-23 20:33:58,242 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 1/1 2016-12-23 20:33:58,750 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Moving data to: /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/row_count 2016-12-23 20:34:14,086 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : OK 2016-12-23 20:34:14,159 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Time taken: 67.977 seconds 2016-12-23 20:34:14,941 DEBUG [pool-8-thread-6] execution.AbstractExecutable:341 : Finding file hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/row_count/000000_0 2016-12-23 20:34:15,059 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : total input rows = 10000 2016-12-23 20:34:15,061 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : expected input rows per mapper = 1000000 2016-12-23 20:34:15,062 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : num reducers for RedistributeFlatHiveTableStep = 1 2016-12-23 20:34:15,062 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Redistribute table, cmd: 2016-12-23 20:34:15,062 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : hive -e "USE default; SET dfs.replication=2; SET hive.exec.compress.output=true; SET hive.auto.convert.join.noconditionaltask=true; SET hive.auto.convert.join.noconditionaltask.size=100000000; SET mapreduce.output.fileoutputformat.compress.type=BLOCK; SET mapreduce.job.split.metainfo.maxsize=-1; set mapreduce.job.reduces=1; set hive.merge.mapredfiles=false; INSERT OVERWRITE TABLE kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 SELECT * FROM kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 DISTRIBUTE BY RAND(); " 2016-12-23 20:34:15,812 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:34:15,816 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:34:27,454 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : WARNING: Use "yarn jar" to launch YARN applications. 2016-12-23 20:34:29,268 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:34:35,303 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:34:35,304 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Logging initialized using configuration in file:/etc/hive/2.4.0.0-169/0/hive-log4j.properties 2016-12-23 20:34:39,445 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:34:58,517 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:35:02,518 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:35:10,123 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-12-23 20:35:13,477 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : OK 2016-12-23 20:35:13,498 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Time taken: 5.439 seconds 2016-12-23 20:35:23,884 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Query ID = root_20161223203513_a32153a8-9d32-494b-99ee-da68c423f279 2016-12-23 20:35:23,886 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Total jobs = 1 2016-12-23 20:35:23,961 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Launching Job 1 out of 1 2016-12-23 20:35:27,515 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:35:27,516 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:35:28,245 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Status: Running (Executing on YARN cluster with App id application_1482519724635_0010) 2016-12-23 20:35:28,245 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : 2016-12-23 20:35:28,248 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: -/- Reducer 2: 0/1 2016-12-23 20:35:28,576 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:35:29,087 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:35:31,608 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:35:34,609 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:35:35,043 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:35:38,212 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:35:41,403 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:35:44,927 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:35:47,963 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0(+1)/1 Reducer 2: 0/1 2016-12-23 20:35:50,519 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 0/1 Reducer 2: 0/1 2016-12-23 20:35:50,726 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 0/1 2016-12-23 20:35:50,990 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 0(+1)/1 2016-12-23 20:35:54,099 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 0(+1)/1 2016-12-23 20:35:54,733 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Map 1: 1/1 Reducer 2: 1/1 2016-12-23 20:35:54,853 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Loading data to table default.kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 2016-12-23 20:35:55,211 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Moved: 'hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6/000000_0' to trash at: hdfs://sandbox.hortonworks.com:8020/user/root/.Trash/Current 2016-12-23 20:35:56,677 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Table default.kylin_intermediate_kylin_sales_cube_desc_dde159aa_cf41_4d76_af7b_9e095509cba6 stats: [numFiles=1, numRows=10000, totalSize=189044, rawDataSize=1104046] 2016-12-23 20:36:07,144 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : OK 2016-12-23 20:36:07,193 INFO [pool-8-thread-6] execution.AbstractExecutable:36 : Time taken: 53.657 seconds 2016-12-23 20:36:08,554 DEBUG [pool-8-thread-6] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-01 2016-12-23 20:36:08,573 DEBUG [pool-8-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-01 from oldTs: 1482525131027, to newTs: 1482525368555, operation result: true 2016-12-23 20:36:08,589 DEBUG [pool-8-thread-6] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-01 2016-12-23 20:36:08,620 DEBUG [pool-8-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-01 from oldTs: 1482525368555, to newTs: 1482525368590, operation result: true 2016-12-23 20:36:08,620 INFO [pool-8-thread-6] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-01 from RUNNING to SUCCEED 2016-12-23 20:36:08,640 DEBUG [pool-8-thread-6] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:36:08,737 DEBUG [pool-8-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525130992, to newTs: 1482525368640, operation result: true 2016-12-23 20:36:08,914 DEBUG [pool-8-thread-6] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:36:08,938 DEBUG [pool-8-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525368640, to newTs: 1482525368914, operation result: true 2016-12-23 20:36:08,938 INFO [pool-8-thread-6] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from RUNNING to READY 2016-12-23 20:36:09,019 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:36:09,020 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:36:09,020 INFO [pool-8-thread-7] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:36:09,029 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:36:09,037 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:36:09,047 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525368914, to newTs: 1482525369038, operation result: true 2016-12-23 20:36:09,048 INFO [pool-8-thread-7] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:36:09,122 INFO [pool-8-thread-7] execution.AbstractExecutable:99 : Executing AbstractExecutable (Extract Fact Table Distinct Columns) 2016-12-23 20:36:09,137 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:09,150 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482524950072, to newTs: 1482525369137, operation result: true 2016-12-23 20:36:09,151 INFO [pool-8-thread-7] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-02 from READY to RUNNING 2016-12-23 20:36:09,361 INFO [pool-8-thread-7] common.MapReduceExecutable:112 : parameters of the MapReduceExecutable: 2016-12-23 20:36:09,361 INFO [pool-8-thread-7] common.MapReduceExecutable:113 : -conf /database/install/kylin/conf/kylin_job_conf.xml -cubename kylin_sales_cube -output /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns -segmentid dde159aa-cf41-4d76-af7b-9e095509cba6 -statisticsenabled true -statisticsoutput /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/statistics -statisticssamplingpercent 100 -jobname Kylin_Fact_Distinct_Columns_kylin_sales_cube_Step -cubingJobId e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:36:10,500 INFO [pool-8-thread-7] steps.FactDistinctColumnsJob:86 : Starting: Kylin_Fact_Distinct_Columns_kylin_sales_cube_Step 2016-12-23 20:36:10,500 INFO [pool-8-thread-7] common.AbstractHadoopJob:163 : append job jar: /database/install/kylin/lib/kylin-job-1.6.0.jar 2016-12-23 20:36:10,500 INFO [pool-8-thread-7] common.AbstractHadoopJob:171 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-12-23 20:36:10,511 INFO [pool-8-thread-7] common.AbstractHadoopJob:188 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-12-23 20:36:10,512 INFO [pool-8-thread-7] common.AbstractHadoopJob:200 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 20:36:10,625 INFO [pool-8-thread-7] common.AbstractHadoopJob:202 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 20:36:10,627 INFO [pool-8-thread-7] common.AbstractHadoopJob:230 : Kafka Dependencies: 2016-12-23 20:36:10,791 INFO [pool-8-thread-7] common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 20:36:10,792 INFO [pool-8-thread-7] steps.FactDistinctColumnsJob:100 : Found segment: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:36:11,213 INFO [pool-8-thread-7] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:36:11,297 INFO [pool-8-thread-7] hive.metastore:478 : Connected to metastore. 2016-12-23 20:36:12,023 INFO [pool-8-thread-7] common.KylinConfig:120 : The URI /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta is recognized as LOCAL_FOLDER 2016-12-23 20:36:12,023 INFO [pool-8-thread-7] common.KylinConfig:267 : New KylinConfig 1740845110 2016-12-23 20:36:12,032 INFO [pool-8-thread-7] common.KylinConfigBase:130 : Kylin Config was updated with kylin.metadata.url : /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta 2016-12-23 20:36:12,032 INFO [pool-8-thread-7] persistence.ResourceStore:80 : Using metadata url /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta for resource store 2016-12-23 20:36:12,038 DEBUG [pool-8-thread-7] persistence.ResourceStore:207 : Directly saving resource /cube/kylin_sales_cube.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta) 2016-12-23 20:36:12,045 DEBUG [pool-8-thread-7] persistence.ResourceStore:207 : Directly saving resource /model_desc/kylin_sales_model.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta) 2016-12-23 20:36:12,053 DEBUG [pool-8-thread-7] persistence.ResourceStore:207 : Directly saving resource /cube_desc/kylin_sales_cube_desc.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta) 2016-12-23 20:36:12,059 DEBUG [pool-8-thread-7] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_CATEGORY_GROUPINGS.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta) 2016-12-23 20:36:12,065 DEBUG [pool-8-thread-7] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_CAL_DT.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta) 2016-12-23 20:36:12,072 DEBUG [pool-8-thread-7] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_SALES.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta) 2016-12-23 20:36:12,073 INFO [pool-8-thread-7] common.AbstractHadoopJob:499 : HDFS meta dir is: file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta 2016-12-23 20:36:12,073 INFO [pool-8-thread-7] common.AbstractHadoopJob:372 : Job 'tmpfiles' updated -- file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta 2016-12-23 20:36:12,537 INFO [pool-8-thread-7] impl.TimelineClientImpl:352 : Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-12-23 20:36:12,538 INFO [pool-8-thread-7] client.RMProxy:98 : Connecting to ResourceManager at sandbox.hortonworks.com/192.168.150.148:8050 2016-12-23 20:36:16,841 INFO [pool-8-thread-7] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:36:16,961 INFO [pool-8-thread-7] mapreduce.JobSubmitter:198 : number of splits:1 2016-12-23 20:36:17,470 INFO [pool-8-thread-7] mapreduce.JobSubmitter:287 : Submitting tokens for job: job_1482519724635_0011 2016-12-23 20:36:17,947 INFO [pool-8-thread-7] impl.YarnClientImpl:274 : Submitted application application_1482519724635_0011 2016-12-23 20:36:17,968 INFO [pool-8-thread-7] mapreduce.Job:1294 : The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1482519724635_0011/ 2016-12-23 20:36:17,968 INFO [pool-8-thread-7] common.AbstractHadoopJob:506 : tempMetaFileString is : file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta1684776437069974176/meta 2016-12-23 20:36:18,040 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:18,074 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525369137, to newTs: 1482525378040, operation result: true 2016-12-23 20:36:28,242 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:28,271 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525378040, to newTs: 1482525388242, operation result: true 2016-12-23 20:36:29,339 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:36:38,343 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:38,377 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525388242, to newTs: 1482525398343, operation result: true 2016-12-23 20:36:48,588 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:48,681 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525398343, to newTs: 1482525408589, operation result: true 2016-12-23 20:36:48,684 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:48,691 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525408589, to newTs: 1482525408685, operation result: true 2016-12-23 20:36:58,949 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:36:58,985 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525408685, to newTs: 1482525418949, operation result: true 2016-12-23 20:37:09,017 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:37:09,053 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525418949, to newTs: 1482525429018, operation result: true 2016-12-23 20:37:19,214 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:37:19,221 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525429018, to newTs: 1482525439215, operation result: true 2016-12-23 20:37:29,618 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:37:29,633 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525439215, to newTs: 1482525449618, operation result: true 2016-12-23 20:37:30,292 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:37:39,646 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:37:39,658 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525449618, to newTs: 1482525459647, operation result: true 2016-12-23 20:37:49,700 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:37:58,512 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525459647, to newTs: 1482525469701, operation result: true 2016-12-23 20:38:08,602 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:08,648 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525469701, to newTs: 1482525488603, operation result: true 2016-12-23 20:38:18,657 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:18,666 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525488603, to newTs: 1482525498657, operation result: true 2016-12-23 20:38:31,456 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:31,514 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:38:31,635 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525498657, to newTs: 1482525511456, operation result: true 2016-12-23 20:38:41,771 INFO [pool-8-thread-7] mapred.ClientServiceDelegate:278 : Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server 2016-12-23 20:38:43,575 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:43,592 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525511456, to newTs: 1482525523576, operation result: true 2016-12-23 20:38:43,726 DEBUG [pool-8-thread-7] common.HadoopCmdOutput:94 : Counters: 49 File System Counters FILE: Number of bytes read=206837 FILE: Number of bytes written=1867285 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=191455 HDFS: Number of bytes written=230425 HDFS: Number of read operations=23 HDFS: Number of large read operations=0 HDFS: Number of write operations=16 Job Counters Launched map tasks=1 Launched reduce tasks=5 Data-local map tasks=1 Total time spent by all maps in occupied slots (ms)=19151 Total time spent by all reduces in occupied slots (ms)=398256 Total time spent by all map tasks (ms)=19151 Total time spent by all reduce tasks (ms)=398256 Total vcore-seconds taken by all map tasks=19151 Total vcore-seconds taken by all reduce tasks=398256 Total megabyte-seconds taken by all map tasks=4787750 Total megabyte-seconds taken by all reduce tasks=99564000 Map-Reduce Framework Map input records=10000 Map output records=40064 Map output bytes=972402 Map output materialized bytes=206797 Input split bytes=2411 Combine input records=40064 Combine output records=1801 Reduce input groups=1801 Reduce shuffle bytes=206797 Reduce input records=1801 Reduce output records=0 Spilled Records=3602 Shuffled Maps =5 Failed Shuffles=0 Merged Map outputs=5 GC time elapsed (ms)=12450 CPU time spent (ms)=51160 Physical memory (bytes) snapshot=1005027328 Virtual memory (bytes) snapshot=5175091200 Total committed heap usage (bytes)=803209216 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=0 File Output Format Counters Bytes Written=645 2016-12-23 20:38:43,731 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:43,753 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525523576, to newTs: 1482525523731, operation result: true 2016-12-23 20:38:43,762 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:43,775 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525523731, to newTs: 1482525523763, operation result: true 2016-12-23 20:38:43,786 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-02 2016-12-23 20:38:43,806 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-02 from oldTs: 1482525523763, to newTs: 1482525523786, operation result: true 2016-12-23 20:38:43,806 INFO [pool-8-thread-7] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-02 from RUNNING to SUCCEED 2016-12-23 20:38:43,878 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:38:43,896 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525369038, to newTs: 1482525523878, operation result: true 2016-12-23 20:38:44,106 DEBUG [pool-8-thread-7] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:38:44,122 DEBUG [pool-8-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525523878, to newTs: 1482525524106, operation result: true 2016-12-23 20:38:44,122 INFO [pool-8-thread-7] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from RUNNING to READY 2016-12-23 20:38:44,175 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:38:44,186 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:38:44,191 INFO [pool-8-thread-8] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:38:44,235 DEBUG [pool-8-thread-8] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:38:44,242 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:38:44,262 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525524106, to newTs: 1482525524236, operation result: true 2016-12-23 20:38:44,262 INFO [pool-8-thread-8] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:38:44,425 INFO [pool-8-thread-8] execution.AbstractExecutable:99 : Executing AbstractExecutable (Build Dimension Dictionary) 2016-12-23 20:38:44,432 DEBUG [pool-8-thread-8] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-03 2016-12-23 20:38:44,451 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-03 from oldTs: 1482524950114, to newTs: 1482525524432, operation result: true 2016-12-23 20:38:44,451 INFO [pool-8-thread-8] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-03 from READY to RUNNING 2016-12-23 20:38:44,555 INFO [pool-8-thread-8] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable: 2016-12-23 20:38:44,556 INFO [pool-8-thread-8] common.HadoopShellExecutable:59 : -cubename kylin_sales_cube -segmentid dde159aa-cf41-4d76-af7b-9e095509cba6 -input /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns 2016-12-23 20:38:45,016 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_SALES.LEAF_CATEG_ID 2016-12-23 20:38:45,016 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_SALES.LEAF_CATEG_ID 2016-12-23 20:38:45,311 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:45,316 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:45,998 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"5cb4714c-b84e-4673-a678-dfa1aaaa6560","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_CATEGORY_GROUPINGS","source_column":"LEAF_CATEG_ID","source_column_index":0,"data_type":"bigint","input":{"path":"hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings","size":49634,"last_modified_time":1482521470711},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:46,548 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:46,550 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:46,972 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:47,041 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:38:47,607 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: 48027=>67, 164261=>126, 82494=>93, 66767=>84, 152801=>118 2016-12-23 20:38:47,607 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 134 2016-12-23 20:38:47,607 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$NumberDictBuilder 2016-12-23 20:38:47,608 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.NumberDictionary2 2016-12-23 20:38:47,608 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:47,623 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/LEAF_CATEG_ID/5cb4714c-b84e-4673-a678-dfa1aaaa6560.dict 2016-12-23 20:38:47,628 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/LEAF_CATEG_ID/5cb4714c-b84e-4673-a678-dfa1aaaa6560.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:47,669 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:47,670 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:47,673 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:47,690 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482524949491, to newTs: 1482525527674, operation result: true 2016-12-23 20:38:47,690 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:47,690 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME 2016-12-23 20:38:47,694 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME 2016-12-23 20:38:47,706 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:47,716 INFO [http-bio-7070-exec-2] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:47,717 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:47,717 INFO [http-bio-7070-exec-2] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:47,717 INFO [http-bio-7070-exec-2] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:47,718 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:47,718 DEBUG [http-bio-7070-exec-2] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:47,908 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:47,915 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:48,223 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"6feb722a-b6cc-4984-a6c5-381a48f19364","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_CATEGORY_GROUPINGS","source_column":"META_CATEG_NAME","source_column_index":13,"data_type":"varchar(256)","input":{"path":"hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings","size":49634,"last_modified_time":1482521470711},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:48,753 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:48,849 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:38:49,035 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: Coins & Paper Money=>11, Jewelry & Watches=>26, BookMagazines=>2, Home & Garden=>24, Health & Beauty=>22 2016-12-23 20:38:49,035 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 44 2016-12-23 20:38:49,035 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$StringDictBuilder 2016-12-23 20:38:49,035 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.TrieDictionary 2016-12-23 20:38:49,035 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:49,167 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/META_CATEG_NAME/6feb722a-b6cc-4984-a6c5-381a48f19364.dict 2016-12-23 20:38:49,168 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/META_CATEG_NAME/6feb722a-b6cc-4984-a6c5-381a48f19364.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:49,185 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:49,185 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:49,186 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:49,206 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525527674, to newTs: 1482525529187, operation result: true 2016-12-23 20:38:49,206 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:49,206 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME 2016-12-23 20:38:49,211 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME 2016-12-23 20:38:49,215 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:49,220 INFO [http-bio-7070-exec-4] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:49,221 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:49,221 INFO [http-bio-7070-exec-4] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:49,221 INFO [http-bio-7070-exec-4] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:49,222 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:49,222 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:49,409 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:49,411 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:49,703 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"62a1c81d-f928-4c48-a6f9-1c55d16ac853","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_CATEGORY_GROUPINGS","source_column":"CATEG_LVL2_NAME","source_column_index":20,"data_type":"varchar(256)","input":{"path":"hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings","size":49634,"last_modified_time":1482521470711},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:50,172 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:50,184 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:38:50,294 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: Paper Money: World=>67, Fashion Jewelry=>28, NULL=>61, Bath & Body=>6, Action Figures=>0 2016-12-23 20:38:50,295 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 94 2016-12-23 20:38:50,295 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$StringDictBuilder 2016-12-23 20:38:50,295 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.TrieDictionary 2016-12-23 20:38:50,295 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:50,368 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/CATEG_LVL2_NAME/62a1c81d-f928-4c48-a6f9-1c55d16ac853.dict 2016-12-23 20:38:50,368 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/CATEG_LVL2_NAME/62a1c81d-f928-4c48-a6f9-1c55d16ac853.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:50,399 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:50,400 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:50,400 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:50,431 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525529187, to newTs: 1482525530401, operation result: true 2016-12-23 20:38:50,431 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME 2016-12-23 20:38:50,431 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME 2016-12-23 20:38:50,439 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:50,445 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:50,450 INFO [http-bio-7070-exec-4] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:50,451 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:50,451 INFO [http-bio-7070-exec-4] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:50,452 INFO [http-bio-7070-exec-4] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:50,452 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:50,452 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:50,612 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:50,618 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:50,874 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"341eed0b-b83b-490d-b7ca-35d7061289d1","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_CATEGORY_GROUPINGS","source_column":"CATEG_LVL3_NAME","source_column_index":21,"data_type":"varchar(256)","input":{"path":"hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings","size":49634,"last_modified_time":1482521470711},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:51,371 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:51,393 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:38:51,440 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: Asia=>8, Earrings=>44, Comic Books=>36, Dogs=>42, Cheese & Crackers=>32 2016-12-23 20:38:51,440 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 127 2016-12-23 20:38:51,440 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$StringDictBuilder 2016-12-23 20:38:51,441 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.TrieDictionary 2016-12-23 20:38:51,441 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:51,466 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/CATEG_LVL3_NAME/341eed0b-b83b-490d-b7ca-35d7061289d1.dict 2016-12-23 20:38:51,466 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/CATEG_LVL3_NAME/341eed0b-b83b-490d-b7ca-35d7061289d1.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:51,476 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:51,477 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:51,477 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:51,487 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525530401, to newTs: 1482525531477, operation result: true 2016-12-23 20:38:51,488 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_SALES.USER_ID 2016-12-23 20:38:51,488 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:51,488 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_SALES.USER_ID 2016-12-23 20:38:51,497 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:51,506 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:51,507 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:51,507 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:51,507 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:51,508 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:51,508 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:51,564 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"fca0f589-ba58-441d-a32c-5389ad24b4eb","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_SALES","source_column":"USER_ID","source_column_index":11,"data_type":"varchar(256)","input":{"path":"/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns/USER_ID","size":22,"last_modified_time":1482525512385},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:52,010 INFO [pool-8-thread-8] mr.DFSFileTableReader:163 : Auto detect delim to be null, will take THE-WHOLE-LINE as a single value, for /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns/USER_ID 2016-12-23 20:38:52,011 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: ADMIN=>0, ANALYST=>1, MODELER=>2 2016-12-23 20:38:52,011 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 3 2016-12-23 20:38:52,011 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$StringDictBuilder 2016-12-23 20:38:52,012 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.TrieDictionary 2016-12-23 20:38:52,012 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:52,021 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_SALES/USER_ID/fca0f589-ba58-441d-a32c-5389ad24b4eb.dict 2016-12-23 20:38:52,022 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_SALES/USER_ID/fca0f589-ba58-441d-a32c-5389ad24b4eb.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:52,033 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:52,034 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:52,034 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:52,047 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525531477, to newTs: 1482525532034, operation result: true 2016-12-23 20:38:52,047 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_SALES.REGION 2016-12-23 20:38:52,047 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_SALES.REGION 2016-12-23 20:38:52,047 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:52,057 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:52,063 INFO [http-bio-7070-exec-1] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:52,064 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:52,064 INFO [http-bio-7070-exec-1] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:52,064 INFO [http-bio-7070-exec-1] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:52,065 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:52,066 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:52,258 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"e317f02e-405a-4ecf-8d73-5de132ef9421","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_SALES","source_column":"REGION","source_column_index":12,"data_type":"varchar(256)","input":{"path":"/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns/REGION","size":26,"last_modified_time":1482525512512},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:52,376 INFO [pool-8-thread-8] mr.DFSFileTableReader:163 : Auto detect delim to be null, will take THE-WHOLE-LINE as a single value, for /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns/REGION 2016-12-23 20:38:52,376 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: Beijing=>0, Hongkong=>1, Shanghai=>2 2016-12-23 20:38:52,376 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 3 2016-12-23 20:38:52,376 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$StringDictBuilder 2016-12-23 20:38:52,376 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.TrieDictionary 2016-12-23 20:38:52,377 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:52,385 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_SALES/REGION/e317f02e-405a-4ecf-8d73-5de132ef9421.dict 2016-12-23 20:38:52,385 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_SALES/REGION/e317f02e-405a-4ecf-8d73-5de132ef9421.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:52,395 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:52,395 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:52,395 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:52,404 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525532034, to newTs: 1482525532395, operation result: true 2016-12-23 20:38:52,404 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:52,404 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_SALES.LSTG_SITE_ID 2016-12-23 20:38:52,405 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_SALES.LSTG_SITE_ID 2016-12-23 20:38:52,410 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:52,414 INFO [http-bio-7070-exec-1] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:52,415 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:52,415 INFO [http-bio-7070-exec-1] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:52,415 INFO [http-bio-7070-exec-1] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:52,416 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:52,416 DEBUG [http-bio-7070-exec-1] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:52,638 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:52,640 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:53,003 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"1114b595-d695-4592-9368-6acd235f857d","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_CATEGORY_GROUPINGS","source_column":"SITE_ID","source_column_index":2,"data_type":"integer","input":{"path":"hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings","size":49634,"last_modified_time":1482521470711},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:53,485 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:53,499 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:38:53,519 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: 0=>0, 15=>3, 100=>5, 3=>2, 23=>4 2016-12-23 20:38:53,520 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 8 2016-12-23 20:38:53,520 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$NumberDictBuilder 2016-12-23 20:38:53,520 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.NumberDictionary2 2016-12-23 20:38:53,520 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:53,534 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/SITE_ID/1114b595-d695-4592-9368-6acd235f857d.dict 2016-12-23 20:38:53,535 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/SITE_ID/1114b595-d695-4592-9368-6acd235f857d.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:53,542 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:53,543 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:53,543 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:53,554 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525532395, to newTs: 1482525533543, operation result: true 2016-12-23 20:38:53,554 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:49 : Building dictionary for DEFAULT.KYLIN_SALES.SELLER_ID 2016-12-23 20:38:53,554 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:53,560 INFO [pool-8-thread-8] dict.DictionaryManager:279 : building dictionary for DEFAULT.KYLIN_SALES.SELLER_ID 2016-12-23 20:38:53,566 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:53,573 INFO [http-bio-7070-exec-3] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:53,575 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:53,576 INFO [http-bio-7070-exec-3] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:53,576 INFO [http-bio-7070-exec-3] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:53,577 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:53,582 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:53,638 INFO [pool-8-thread-8] dict.DictionaryManager:314 : Building dictionary object {"uuid":"b7a82f33-7475-4ab2-8896-2b9e5e6cfd07","last_modified":0,"version":"1.6.0","source_table":"DEFAULT.KYLIN_SALES","source_column":"SELLER_ID","source_column_index":8,"data_type":"bigint","input":{"path":"/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns/SELLER_ID","size":9000,"last_modified_time":1482525512411},"dictionary_class":null,"cardinality":0} 2016-12-23 20:38:53,887 INFO [pool-8-thread-8] mr.DFSFileTableReader:163 : Auto detect delim to be null, will take THE-WHOLE-LINE as a single value, for /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/fact_distinct_columns/SELLER_ID 2016-12-23 20:38:53,917 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:91 : Dictionary value samples: 10000000=>0, 10000001=>1, 10000002=>2, 10000003=>3, 10000004=>4 2016-12-23 20:38:53,917 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:92 : Dictionary cardinality: 1000 2016-12-23 20:38:53,917 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:93 : Dictionary builder class: org.apache.kylin.dict.DictionaryGenerator$NumberDictBuilder 2016-12-23 20:38:53,917 DEBUG [pool-8-thread-8] dict.DictionaryGenerator:94 : Dictionary class: org.apache.kylin.dict.NumberDictionary2 2016-12-23 20:38:53,917 INFO [pool-8-thread-8] dict.DictionaryManager:169 : Growing dict is not enabled 2016-12-23 20:38:53,933 INFO [pool-8-thread-8] dict.DictionaryManager:404 : Saving dictionary at /dict/DEFAULT.KYLIN_SALES/SELLER_ID/b7a82f33-7475-4ab2-8896-2b9e5e6cfd07.dict 2016-12-23 20:38:53,937 DEBUG [pool-8-thread-8] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_SALES/SELLER_ID/b7a82f33-7475-4ab2-8896-2b9e5e6cfd07.dict (Store kylin_metadata@hbase) 2016-12-23 20:38:53,955 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:53,956 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:53,958 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:53,979 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525533543, to newTs: 1482525533959, operation result: true 2016-12-23 20:38:53,979 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:53,981 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:57 : Building snapshot of DEFAULT.KYLIN_CAL_DT 2016-12-23 20:38:53,996 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:54,034 INFO [http-bio-7070-exec-3] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:54,037 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:54,037 INFO [http-bio-7070-exec-3] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:54,038 INFO [http-bio-7070-exec-3] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:54,038 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:54,089 DEBUG [http-bio-7070-exec-3] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:54,272 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:54,290 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:38:55,618 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:55,634 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CAL_DT, numFiles=1, field.delim=,, columns.types=date,date,date,date,date,smallint,smallint,smallint,smallint,smallint,smallint,smallint,smallint,smallint,smallint,int,smallint,smallint,smallint,int,tinyint,int,tinyint,tinyint,smallint,tinyint,smallint,smallint,string,string,string,string,string,string,string,tinyint,tinyint,tinyint,tinyint,string,smallint,tinyint,tinyint,tinyint,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,string,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,string,string,string,string, serialization.format=,, columns=cal_dt,year_beg_dt,qtr_beg_dt,month_beg_dt,week_beg_dt,age_for_year_id,age_for_qtr_id,age_for_month_id,age_for_week_id,age_for_dt_id,age_for_rtl_year_id,age_for_rtl_qtr_id,age_for_rtl_month_id,age_for_rtl_week_id,age_for_cs_week_id,day_of_cal_id,day_of_year_id,day_of_qtr_id,day_of_month_id,day_of_week_id,week_of_year_id,week_of_cal_id,month_of_qtr_id,month_of_year_id,month_of_cal_id,qtr_of_year_id,qtr_of_cal_id,year_of_cal_id,year_end_dt,qtr_end_dt,month_end_dt,week_end_dt,cal_dt_name,cal_dt_desc,cal_dt_short_name,ytd_yn_id,qtd_yn_id,mtd_yn_id,wtd_yn_id,season_beg_dt,day_in_year_count,day_in_qtr_count,day_in_month_count,day_in_week_count,rtl_year_beg_dt,rtl_qtr_beg_dt,rtl_month_beg_dt,rtl_week_beg_dt,cs_week_beg_dt,cal_date,day_of_week,month_id,prd_desc,prd_flag,prd_id,prd_ind,qtr_desc,qtr_id,qtr_ind,retail_week,retail_year,retail_start_date,retail_wk_end_date,week_ind,week_num_desc,week_beg_date,week_end_date,week_in_year_id,week_id,week_beg_end_desc_mdy,week_beg_end_desc_md,year_id,year_ind,cal_dt_mns_1year_dt,cal_dt_mns_2year_dt,cal_dt_mns_1qtr_dt,cal_dt_mns_2qtr_dt,cal_dt_mns_1month_dt,cal_dt_mns_2month_dt,cal_dt_mns_1week_dt,cal_dt_mns_2week_dt,curr_cal_dt_mns_1year_yn_id,curr_cal_dt_mns_2year_yn_id,curr_cal_dt_mns_1qtr_yn_id,curr_cal_dt_mns_2qtr_yn_id,curr_cal_dt_mns_1month_yn_id,curr_cal_dt_mns_2month_yn_id,curr_cal_dt_mns_1week_yn_ind,curr_cal_dt_mns_2week_yn_ind,rtl_month_of_rtl_year_id,rtl_qtr_of_rtl_year_id,rtl_week_of_rtl_year_id,season_of_year_id,ytm_yn_id,ytq_yn_id,ytw_yn_id,kylin_cal_dt_cre_date,kylin_cal_dt_cre_user,kylin_cal_dt_upd_date,kylin_cal_dt_upd_user, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Date Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=512997, serialization.null.format=\N, transient_lastDdlTime=1482521607} 2016-12-23 20:38:57,096 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:38:57,128 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CAL_DT, numFiles=1, field.delim=,, columns.types=date,date,date,date,date,smallint,smallint,smallint,smallint,smallint,smallint,smallint,smallint,smallint,smallint,int,smallint,smallint,smallint,int,tinyint,int,tinyint,tinyint,smallint,tinyint,smallint,smallint,string,string,string,string,string,string,string,tinyint,tinyint,tinyint,tinyint,string,smallint,tinyint,tinyint,tinyint,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,string,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,string,tinyint,tinyint,tinyint,tinyint,tinyint,tinyint,string,string,string,string, serialization.format=,, columns=cal_dt,year_beg_dt,qtr_beg_dt,month_beg_dt,week_beg_dt,age_for_year_id,age_for_qtr_id,age_for_month_id,age_for_week_id,age_for_dt_id,age_for_rtl_year_id,age_for_rtl_qtr_id,age_for_rtl_month_id,age_for_rtl_week_id,age_for_cs_week_id,day_of_cal_id,day_of_year_id,day_of_qtr_id,day_of_month_id,day_of_week_id,week_of_year_id,week_of_cal_id,month_of_qtr_id,month_of_year_id,month_of_cal_id,qtr_of_year_id,qtr_of_cal_id,year_of_cal_id,year_end_dt,qtr_end_dt,month_end_dt,week_end_dt,cal_dt_name,cal_dt_desc,cal_dt_short_name,ytd_yn_id,qtd_yn_id,mtd_yn_id,wtd_yn_id,season_beg_dt,day_in_year_count,day_in_qtr_count,day_in_month_count,day_in_week_count,rtl_year_beg_dt,rtl_qtr_beg_dt,rtl_month_beg_dt,rtl_week_beg_dt,cs_week_beg_dt,cal_date,day_of_week,month_id,prd_desc,prd_flag,prd_id,prd_ind,qtr_desc,qtr_id,qtr_ind,retail_week,retail_year,retail_start_date,retail_wk_end_date,week_ind,week_num_desc,week_beg_date,week_end_date,week_in_year_id,week_id,week_beg_end_desc_mdy,week_beg_end_desc_md,year_id,year_ind,cal_dt_mns_1year_dt,cal_dt_mns_2year_dt,cal_dt_mns_1qtr_dt,cal_dt_mns_2qtr_dt,cal_dt_mns_1month_dt,cal_dt_mns_2month_dt,cal_dt_mns_1week_dt,cal_dt_mns_2week_dt,curr_cal_dt_mns_1year_yn_id,curr_cal_dt_mns_2year_yn_id,curr_cal_dt_mns_1qtr_yn_id,curr_cal_dt_mns_2qtr_yn_id,curr_cal_dt_mns_1month_yn_id,curr_cal_dt_mns_2month_yn_id,curr_cal_dt_mns_1week_yn_ind,curr_cal_dt_mns_2week_yn_ind,rtl_month_of_rtl_year_id,rtl_qtr_of_rtl_year_id,rtl_week_of_rtl_year_id,season_of_year_id,ytm_yn_id,ytq_yn_id,ytw_yn_id,kylin_cal_dt_cre_date,kylin_cal_dt_cre_user,kylin_cal_dt_upd_date,kylin_cal_dt_upd_user, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Date Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=512997, serialization.null.format=\N, transient_lastDdlTime=1482521607} 2016-12-23 20:38:57,874 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /table_snapshot/DEFAULT.KYLIN_CAL_DT/9e894ac7-003e-4cb3-9872-57c99c85948a.snapshot from oldTs: 0, to newTs: 1482525537451, operation result: true 2016-12-23 20:38:57,874 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:38:57,875 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:57,875 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:38:58,065 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525533959, to newTs: 1482525537875, operation result: true 2016-12-23 20:38:58,065 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:38:58,069 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:59 : Checking snapshot of DEFAULT.KYLIN_CAL_DT 2016-12-23 20:38:58,079 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:38:58,089 INFO [http-bio-7070-exec-6] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:38:58,089 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:38:58,090 INFO [http-bio-7070-exec-6] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:38:58,090 INFO [http-bio-7070-exec-6] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:38:58,091 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:38:58,091 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:38:58,449 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:57 : Building snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:38:58,628 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:38:58,629 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:39:00,304 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:39:00,335 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:39:01,258 INFO [pool-8-thread-8] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:39:01,269 INFO [pool-8-thread-8] mapreduce.InternalUtil:155 : Initializing org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe with properties {name=DEFAULT.KYLIN_CATEGORY_GROUPINGS, numFiles=1, field.delim=,, columns.types=bigint,string,int,string,string,string,string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),string,string,string,string,string,string,decimal(10,0),string,decimal(10,0),string,decimal(10,0),decimal(10,0),decimal(10,0),decimal(10,0),tinyint,string, serialization.format=,, columns=leaf_categ_id,leaf_categ_name,site_id,categ_busn_mgr,categ_busn_unit,regn_categ,user_defined_field1,user_defined_field3,kylin_groupings_cre_date,kylin_groupings_upd_date,kylin_groupings_cre_user,kylin_groupings_upd_user,meta_categ_id,meta_categ_name,categ_lvl2_id,categ_lvl3_id,categ_lvl4_id,categ_lvl5_id,categ_lvl6_id,categ_lvl7_id,categ_lvl2_name,categ_lvl3_name,categ_lvl4_name,categ_lvl5_name,categ_lvl6_name,categ_lvl7_name,categ_flags,adult_categ_yn,domain_id,user_defined_field5,vcs_id,gcs_id,move_to,sap_category_id,src_id,bsns_vrtcl_name, columns.comments=nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull, comment=Detail category inforamtion, Dimension Table, serialization.lib=org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, COLUMN_STATS_ACCURATE=true, totalSize=49634, serialization.null.format=\N, transient_lastDdlTime=1482521612} 2016-12-23 20:39:01,609 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot from oldTs: 0, to newTs: 1482525541407, operation result: true 2016-12-23 20:39:01,609 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:39:01,609 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:01,609 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:01,677 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525537875, to newTs: 1482525541610, operation result: true 2016-12-23 20:39:01,677 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:59 : Checking snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:01,682 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:39:01,698 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:57 : Building snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:01,739 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:39:01,745 INFO [http-bio-7070-exec-6] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:39:01,745 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:39:01,746 INFO [http-bio-7070-exec-6] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:39:01,746 INFO [http-bio-7070-exec-6] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:39:01,746 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:39:01,747 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:39:01,923 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:39:01,932 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:39:02,431 INFO [pool-8-thread-8] lookup.SnapshotManager:207 : Loading snapshotTable from /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot, with loadData: false 2016-12-23 20:39:02,554 INFO [pool-8-thread-8] lookup.SnapshotManager:123 : Identical input FileSignature [path=hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings, size=49634, lastModifiedTime=1482521470711], reuse existing snapshot at /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot 2016-12-23 20:39:02,554 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:39:02,554 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:02,554 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:02,579 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525541610, to newTs: 1482525542555, operation result: true 2016-12-23 20:39:02,580 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:39:02,580 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:59 : Checking snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:02,583 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:57 : Building snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:02,601 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:39:02,610 INFO [http-bio-7070-exec-6] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:39:02,611 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:39:02,611 INFO [http-bio-7070-exec-6] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:39:02,611 INFO [http-bio-7070-exec-6] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:39:02,612 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:39:02,614 DEBUG [http-bio-7070-exec-6] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:39:02,846 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:39:02,896 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:39:03,201 INFO [pool-8-thread-8] lookup.SnapshotManager:207 : Loading snapshotTable from /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot, with loadData: false 2016-12-23 20:39:03,305 INFO [pool-8-thread-8] lookup.SnapshotManager:123 : Identical input FileSignature [path=hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings, size=49634, lastModifiedTime=1482521470711], reuse existing snapshot at /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot 2016-12-23 20:39:03,305 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:39:03,305 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:03,305 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:03,344 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525542555, to newTs: 1482525543305, operation result: true 2016-12-23 20:39:03,344 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:59 : Checking snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:03,345 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:57 : Building snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:03,348 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:39:03,354 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:39:03,362 INFO [http-bio-7070-exec-9] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:39:03,363 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:39:03,363 INFO [http-bio-7070-exec-9] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:39:03,363 INFO [http-bio-7070-exec-9] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:39:03,364 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:39:03,499 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:39:03,516 INFO [pool-8-thread-8] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:39:03,522 INFO [pool-8-thread-8] hive.metastore:478 : Connected to metastore. 2016-12-23 20:39:03,990 INFO [pool-8-thread-8] lookup.SnapshotManager:207 : Loading snapshotTable from /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot, with loadData: false 2016-12-23 20:39:04,123 INFO [pool-8-thread-8] lookup.SnapshotManager:123 : Identical input FileSignature [path=hdfs://sandbox.hortonworks.com:8020/apps/hive/warehouse/kylin_category_groupings, size=49634, lastModifiedTime=1482521470711], reuse existing snapshot at /table_snapshot/DEFAULT.KYLIN_CATEGORY_GROUPINGS/e7d565e3-4dc2-42ff-a124-6278e7b4e31a.snapshot 2016-12-23 20:39:04,123 INFO [pool-8-thread-8] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:39:04,125 WARN [pool-8-thread-8] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:04,125 WARN [pool-8-thread-8] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:04,147 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525543305, to newTs: 1482525544126, operation result: true 2016-12-23 20:39:04,148 INFO [pool-8-thread-8] cli.DictionaryGeneratorCLI:59 : Checking snapshot of DEFAULT.KYLIN_CATEGORY_GROUPINGS 2016-12-23 20:39:04,148 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:39:04,153 DEBUG [pool-8-thread-8] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-03 2016-12-23 20:39:04,154 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:39:04,169 INFO [http-bio-7070-exec-9] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:39:04,170 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:39:04,171 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-03 from oldTs: 1482525524432, to newTs: 1482525544154, operation result: true 2016-12-23 20:39:04,174 INFO [http-bio-7070-exec-9] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:39:04,181 INFO [http-bio-7070-exec-9] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:39:04,181 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:39:04,197 DEBUG [http-bio-7070-exec-9] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:39:04,214 DEBUG [pool-8-thread-8] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-03 2016-12-23 20:39:04,237 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-03 from oldTs: 1482525544154, to newTs: 1482525544214, operation result: true 2016-12-23 20:39:04,237 INFO [pool-8-thread-8] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-03 from RUNNING to SUCCEED 2016-12-23 20:39:04,303 DEBUG [pool-8-thread-8] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:04,318 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525524236, to newTs: 1482525544303, operation result: true 2016-12-23 20:39:04,549 DEBUG [pool-8-thread-8] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:04,558 DEBUG [pool-8-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525544303, to newTs: 1482525544549, operation result: true 2016-12-23 20:39:04,558 INFO [pool-8-thread-8] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from RUNNING to READY 2016-12-23 20:39:04,594 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:39:04,596 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:39:04,596 INFO [pool-8-thread-9] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:39:04,601 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:39:04,608 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:04,628 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525544549, to newTs: 1482525544608, operation result: true 2016-12-23 20:39:04,628 INFO [pool-8-thread-9] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:39:04,694 INFO [pool-8-thread-9] execution.AbstractExecutable:99 : Executing AbstractExecutable (Save Cuboid Statistics) 2016-12-23 20:39:04,708 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-04 2016-12-23 20:39:04,722 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-04 from oldTs: 1482524950123, to newTs: 1482525544708, operation result: true 2016-12-23 20:39:04,722 INFO [pool-8-thread-9] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-04 from READY to RUNNING 2016-12-23 20:39:04,843 DEBUG [pool-8-thread-9] persistence.ResourceStore:207 : Directly saving resource /cube_statistics/kylin_sales_cube/dde159aa-cf41-4d76-af7b-9e095509cba6.seq (Store kylin_metadata@hbase) 2016-12-23 20:39:04,946 INFO [pool-8-thread-9] steps.SaveStatisticsStep:97 : This cube has memory-hungry measure COUNT_DISTINCT 2016-12-23 20:39:04,947 INFO [pool-8-thread-9] steps.SaveStatisticsStep:97 : This cube has memory-hungry measure COUNT_DISTINCT 2016-12-23 20:39:04,947 INFO [pool-8-thread-9] steps.SaveStatisticsStep:97 : This cube has memory-hungry measure TOP_N 2016-12-23 20:39:04,947 INFO [pool-8-thread-9] steps.SaveStatisticsStep:114 : The cube algorithm for kylin_sales_cube[20120101000000_20161201063000] is LAYER 2016-12-23 20:39:04,971 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:04,985 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525544608, to newTs: 1482525544971, operation result: true 2016-12-23 20:39:05,016 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-04 2016-12-23 20:39:05,112 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-04 from oldTs: 1482525544708, to newTs: 1482525545017, operation result: true 2016-12-23 20:39:05,127 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-04 2016-12-23 20:39:05,139 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-04 from oldTs: 1482525545017, to newTs: 1482525545128, operation result: true 2016-12-23 20:39:05,139 INFO [pool-8-thread-9] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-04 from RUNNING to SUCCEED 2016-12-23 20:39:05,191 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:05,204 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525544971, to newTs: 1482525545191, operation result: true 2016-12-23 20:39:05,365 DEBUG [pool-8-thread-9] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:05,408 DEBUG [pool-8-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525545191, to newTs: 1482525545365, operation result: true 2016-12-23 20:39:05,409 INFO [pool-8-thread-9] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from RUNNING to READY 2016-12-23 20:39:05,497 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:39:05,499 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:39:05,500 INFO [pool-8-thread-10] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:39:05,505 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:39:05,514 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:05,523 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525545365, to newTs: 1482525545514, operation result: true 2016-12-23 20:39:05,523 INFO [pool-8-thread-10] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:39:05,592 INFO [pool-8-thread-10] execution.AbstractExecutable:99 : Executing AbstractExecutable (Create HTable) 2016-12-23 20:39:05,596 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-05 2016-12-23 20:39:05,605 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-05 from oldTs: 1482524950135, to newTs: 1482525545596, operation result: true 2016-12-23 20:39:05,606 INFO [pool-8-thread-10] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-05 from READY to RUNNING 2016-12-23 20:39:05,674 INFO [pool-8-thread-10] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable: 2016-12-23 20:39:05,674 INFO [pool-8-thread-10] common.HadoopShellExecutable:59 : -cubename kylin_sales_cube -segmentid dde159aa-cf41-4d76-af7b-9e095509cba6 -partitions hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/rowkey_stats/part-r-00000 -statisticsenabled true 2016-12-23 20:39:05,913 INFO [pool-8-thread-10] compress.CodecPool:181 : Got brand-new decompressor [.deflate] 2016-12-23 20:39:06,121 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,122 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 137 has 685 rows, each row size is 42103 bytes. Total size is 1.3752248287200928M. 2016-12-23 20:39:06,122 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,122 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 136 has 649 rows, each row size is 42102 bytes. Total size is 1.3029192924499513M. 2016-12-23 20:39:06,122 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,122 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 1 has 7 rows, each row size is 42090 bytes. Total size is 0.014049053192138672M. 2016-12-23 20:39:06,123 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,123 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 129 has 144 rows, each row size is 42091 bytes. Total size is 0.2890159606933594M. 2016-12-23 20:39:06,123 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,123 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 8 has 5 rows, each row size is 42101 bytes. Total size is 0.010037660598754883M. 2016-12-23 20:39:06,124 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,124 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 128 has 134 rows, each row size is 42090 bytes. Total size is 0.2689390182495117M. 2016-12-23 20:39:06,125 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,125 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 9 has 28 rows, each row size is 42102 bytes. Total size is 0.056212234497070315M. 2016-12-23 20:39:06,126 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,126 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 393 has 9792 rows, each row size is 42106 bytes. Total size is 19.660089111328126M. 2016-12-23 20:39:06,126 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,126 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 256 has 733 rows, each row size is 42092 bytes. Total size is 1.4712064743041993M. 2016-12-23 20:39:06,127 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,127 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 392 has 9786 rows, each row size is 42105 bytes. Total size is 19.647575855255127M. 2016-12-23 20:39:06,127 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,127 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 257 has 1511 rows, each row size is 42093 bytes. Total size is 3.03280463218689M. 2016-12-23 20:39:06,127 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,127 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 264 has 3376 rows, each row size is 42104 bytes. Total size is 6.777911376953125M. 2016-12-23 20:39:06,128 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,128 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 385 has 9197 rows, each row size is 42094 bytes. Total size is 18.460203075408938M. 2016-12-23 20:39:06,128 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,128 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 384 has 9162 rows, each row size is 42093 bytes. Total size is 18.389514255523682M. 2016-12-23 20:39:06,129 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,129 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 265 has 4331 rows, each row size is 42105 bytes. Total size is 8.69544768333435M. 2016-12-23 20:39:06,130 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,130 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 64 has 43 rows, each row size is 42090 bytes. Total size is 0.08630132675170898M. 2016-12-23 20:39:06,130 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,131 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 201 has 688 rows, each row size is 42104 bytes. Total size is 1.381280517578125M. 2016-12-23 20:39:06,131 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,131 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 65 has 53 rows, each row size is 42091 bytes. Total size is 0.106373929977417M. 2016-12-23 20:39:06,131 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,131 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 200 has 675 rows, each row size is 42103 bytes. Total size is 1.3551485538482666M. 2016-12-23 20:39:06,131 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,132 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 72 has 209 rows, each row size is 42102 bytes. Total size is 0.41958417892456057M. 2016-12-23 20:39:06,132 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,132 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 193 has 144 rows, each row size is 42092 bytes. Total size is 0.2890228271484375M. 2016-12-23 20:39:06,132 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,132 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 73 has 255 rows, each row size is 42103 bytes. Total size is 0.5119450092315674M. 2016-12-23 20:39:06,133 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,133 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 192 has 139 rows, each row size is 42091 bytes. Total size is 0.2789806842803955M. 2016-12-23 20:39:06,133 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,133 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 457 has 9687 rows, each row size is 42107 bytes. Total size is 19.44973511695862M. 2016-12-23 20:39:06,133 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,133 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 320 has 6513 rows, each row size is 42093 bytes. Total size is 13.07257218360901M. 2016-12-23 20:39:06,134 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,134 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 456 has 9640 rows, each row size is 42106 bytes. Total size is 19.354907989501953M. 2016-12-23 20:39:06,134 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,134 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 321 has 6774 rows, each row size is 42094 bytes. Total size is 13.596761512756348M. 2016-12-23 20:39:06,135 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,135 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 449 has 9273 rows, each row size is 42095 bytes. Total size is 18.613192319869995M. 2016-12-23 20:39:06,135 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,135 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 328 has 8992 rows, each row size is 42105 bytes. Total size is 18.053443908691406M. 2016-12-23 20:39:06,135 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,135 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 448 has 9217 rows, each row size is 42094 bytes. Total size is 18.500347042083742M. 2016-12-23 20:39:06,136 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,136 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 329 has 8969 rows, each row size is 42106 bytes. Total size is 18.00769395828247M. 2016-12-23 20:39:06,136 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,136 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 511 has 9775 rows, each row size is 42111 bytes. Total size is 19.62828755378723M. 2016-12-23 20:39:06,136 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,136 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 504 has 9656 rows, each row size is 42108 bytes. Total size is 19.38795318603516M. 2016-12-23 20:39:06,137 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,137 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 369 has 9241 rows, each row size is 42096 bytes. Total size is 18.549401092529298M. 2016-12-23 20:39:06,137 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,137 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 505 has 9725 rows, each row size is 42109 bytes. Total size is 19.526959657669067M. 2016-12-23 20:39:06,137 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,137 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 368 has 9190 rows, each row size is 42095 bytes. Total size is 18.446590900421143M. 2016-12-23 20:39:06,138 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,138 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 96 has 104 rows, each row size is 42091 bytes. Total size is 0.20873374938964845M. 2016-12-23 20:39:06,138 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,138 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 233 has 684 rows, each row size is 42105 bytes. Total size is 1.3732824325561523M. 2016-12-23 20:39:06,138 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,139 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 97 has 108 rows, each row size is 42092 bytes. Total size is 0.21676712036132814M. 2016-12-23 20:39:06,139 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,139 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 232 has 677 rows, each row size is 42104 bytes. Total size is 1.3591960906982423M. 2016-12-23 20:39:06,139 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,139 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 496 has 9194 rows, each row size is 42096 bytes. Total size is 18.455058288574218M. 2016-12-23 20:39:06,139 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,140 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 377 has 9801 rows, each row size is 42108 bytes. Total size is 19.679093742370608M. 2016-12-23 20:39:06,140 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,140 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 497 has 9259 rows, each row size is 42097 bytes. Total size is 18.585973882675173M. 2016-12-23 20:39:06,140 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,140 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 376 has 9744 rows, each row size is 42107 bytes. Total size is 19.564180755615237M. 2016-12-23 20:39:06,140 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 104 has 506 rows, each row size is 42103 bytes. Total size is 1.0158595085144044M. 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 225 has 144 rows, each row size is 42093 bytes. Total size is 0.28902969360351566M. 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 224 has 140 rows, each row size is 42092 bytes. Total size is 0.2809944152832031M. 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,141 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 105 has 532 rows, each row size is 42104 bytes. Total size is 1.0680831909179689M. 2016-12-23 20:39:06,142 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,142 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 352 has 8717 rows, each row size is 42094 bytes. Total size is 17.496747875213625M. 2016-12-23 20:39:06,142 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,142 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 489 has 9714 rows, each row size is 42108 bytes. Total size is 19.504409408569337M. 2016-12-23 20:39:06,142 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,142 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 353 has 8741 rows, each row size is 42095 bytes. Total size is 17.545337438583374M. 2016-12-23 20:39:06,143 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,143 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 488 has 9705 rows, each row size is 42107 bytes. Total size is 19.485875844955444M. 2016-12-23 20:39:06,143 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,143 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 248 has 692 rows, each row size is 42105 bytes. Total size is 1.3893442153930664M. 2016-12-23 20:39:06,143 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,143 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 113 has 139 rows, each row size is 42093 bytes. Total size is 0.2789939403533936M. 2016-12-23 20:39:06,144 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,144 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 249 has 681 rows, each row size is 42106 bytes. Total size is 1.3672917366027832M. 2016-12-23 20:39:06,144 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,144 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 112 has 138 rows, each row size is 42092 bytes. Total size is 0.2769802093505859M. 2016-12-23 20:39:06,145 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,145 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 360 has 9737 rows, each row size is 42106 bytes. Total size is 19.549661731719972M. 2016-12-23 20:39:06,145 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,145 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 481 has 9296 rows, each row size is 42096 bytes. Total size is 18.65980224609375M. 2016-12-23 20:39:06,145 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,145 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 361 has 9541 rows, each row size is 42107 bytes. Total size is 19.15659365653992M. 2016-12-23 20:39:06,146 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,146 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 480 has 9297 rows, each row size is 42095 bytes. Total size is 18.66136622428894M. 2016-12-23 20:39:06,146 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,146 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 240 has 142 rows, each row size is 42093 bytes. Total size is 0.2850153923034668M. 2016-12-23 20:39:06,146 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,146 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 121 has 666 rows, each row size is 42105 bytes. Total size is 1.3371434211730957M. 2016-12-23 20:39:06,147 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,147 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 241 has 144 rows, each row size is 42094 bytes. Total size is 0.28903656005859374M. 2016-12-23 20:39:06,147 INFO [pool-8-thread-10] common.CubeStatsReader:211 : Cube is memory hungry, storage size estimation multiply 0.05 2016-12-23 20:39:06,147 INFO [pool-8-thread-10] common.CubeStatsReader:218 : Cuboid 120 has 663 rows, each row size is 42104 bytes. Total size is 1.3310886383056642M. 2016-12-23 20:39:06,148 INFO [pool-8-thread-10] steps.CreateHTableJob:157 : Cut for HBase region is 5.0GB 2016-12-23 20:39:06,148 INFO [pool-8-thread-10] steps.CreateHTableJob:192 : Total size 576.7785753726957M (estimated) 2016-12-23 20:39:06,148 INFO [pool-8-thread-10] steps.CreateHTableJob:193 : Expecting 1 regions. 2016-12-23 20:39:06,148 INFO [pool-8-thread-10] steps.CreateHTableJob:194 : Expecting 576 MB per region. 2016-12-23 20:39:06,162 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 1 's estimated size 0.01 MB will generate 1 regions 2016-12-23 20:39:06,168 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 8 's estimated size 0.01 MB will generate 1 regions 2016-12-23 20:39:06,168 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 9 's estimated size 0.06 MB will generate 1 regions 2016-12-23 20:39:06,169 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 64 's estimated size 0.09 MB will generate 1 regions 2016-12-23 20:39:06,169 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 65 's estimated size 0.11 MB will generate 1 regions 2016-12-23 20:39:06,169 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 72 's estimated size 0.42 MB will generate 1 regions 2016-12-23 20:39:06,169 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 73 's estimated size 0.51 MB will generate 1 regions 2016-12-23 20:39:06,169 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 96 's estimated size 0.21 MB will generate 1 regions 2016-12-23 20:39:06,170 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 97 's estimated size 0.22 MB will generate 1 regions 2016-12-23 20:39:06,170 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 104 's estimated size 1.02 MB will generate 1 regions 2016-12-23 20:39:06,170 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 105 's estimated size 1.07 MB will generate 1 regions 2016-12-23 20:39:06,170 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 112 's estimated size 0.28 MB will generate 1 regions 2016-12-23 20:39:06,171 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 113 's estimated size 0.28 MB will generate 1 regions 2016-12-23 20:39:06,171 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 120 's estimated size 1.33 MB will generate 1 regions 2016-12-23 20:39:06,174 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 121 's estimated size 1.34 MB will generate 1 regions 2016-12-23 20:39:06,174 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 128 's estimated size 0.27 MB will generate 1 regions 2016-12-23 20:39:06,175 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 129 's estimated size 0.29 MB will generate 1 regions 2016-12-23 20:39:06,175 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 136 's estimated size 1.30 MB will generate 1 regions 2016-12-23 20:39:06,175 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 137 's estimated size 1.38 MB will generate 1 regions 2016-12-23 20:39:06,175 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 192 's estimated size 0.28 MB will generate 1 regions 2016-12-23 20:39:06,176 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 193 's estimated size 0.29 MB will generate 1 regions 2016-12-23 20:39:06,176 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 200 's estimated size 1.36 MB will generate 1 regions 2016-12-23 20:39:06,176 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 201 's estimated size 1.38 MB will generate 1 regions 2016-12-23 20:39:06,177 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 224 's estimated size 0.28 MB will generate 1 regions 2016-12-23 20:39:06,177 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 225 's estimated size 0.29 MB will generate 1 regions 2016-12-23 20:39:06,178 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 232 's estimated size 1.36 MB will generate 1 regions 2016-12-23 20:39:06,178 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 233 's estimated size 1.37 MB will generate 1 regions 2016-12-23 20:39:06,178 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 240 's estimated size 0.29 MB will generate 1 regions 2016-12-23 20:39:06,178 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 241 's estimated size 0.29 MB will generate 1 regions 2016-12-23 20:39:06,179 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 248 's estimated size 1.39 MB will generate 1 regions 2016-12-23 20:39:06,179 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 249 's estimated size 1.37 MB will generate 1 regions 2016-12-23 20:39:06,179 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 256 's estimated size 1.47 MB will generate 1 regions 2016-12-23 20:39:06,179 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 257 's estimated size 3.03 MB will generate 1 regions 2016-12-23 20:39:06,179 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 264 's estimated size 6.78 MB will generate 1 regions 2016-12-23 20:39:06,180 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 265 's estimated size 8.70 MB will generate 1 regions 2016-12-23 20:39:06,180 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 320 's estimated size 13.07 MB will generate 1 regions 2016-12-23 20:39:06,180 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 321 's estimated size 13.60 MB will generate 1 regions 2016-12-23 20:39:06,181 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 328 's estimated size 18.05 MB will generate 1 regions 2016-12-23 20:39:06,181 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 329 's estimated size 18.01 MB will generate 1 regions 2016-12-23 20:39:06,182 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 352 's estimated size 17.50 MB will generate 1 regions 2016-12-23 20:39:06,182 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 353 's estimated size 17.55 MB will generate 1 regions 2016-12-23 20:39:06,183 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 360 's estimated size 19.55 MB will generate 1 regions 2016-12-23 20:39:06,184 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 361 's estimated size 19.16 MB will generate 1 regions 2016-12-23 20:39:06,184 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 368 's estimated size 18.45 MB will generate 1 regions 2016-12-23 20:39:06,185 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 369 's estimated size 18.55 MB will generate 1 regions 2016-12-23 20:39:06,185 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 376 's estimated size 19.56 MB will generate 1 regions 2016-12-23 20:39:06,185 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 377 's estimated size 19.68 MB will generate 1 regions 2016-12-23 20:39:06,185 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 384 's estimated size 18.39 MB will generate 1 regions 2016-12-23 20:39:06,185 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 385 's estimated size 18.46 MB will generate 1 regions 2016-12-23 20:39:06,186 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 392 's estimated size 19.65 MB will generate 1 regions 2016-12-23 20:39:06,186 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 393 's estimated size 19.66 MB will generate 1 regions 2016-12-23 20:39:06,186 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 448 's estimated size 18.50 MB will generate 1 regions 2016-12-23 20:39:06,186 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 449 's estimated size 18.61 MB will generate 1 regions 2016-12-23 20:39:06,186 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 456 's estimated size 19.35 MB will generate 1 regions 2016-12-23 20:39:06,187 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 457 's estimated size 19.45 MB will generate 1 regions 2016-12-23 20:39:06,187 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 480 's estimated size 18.66 MB will generate 1 regions 2016-12-23 20:39:06,187 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 481 's estimated size 18.66 MB will generate 1 regions 2016-12-23 20:39:06,187 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 488 's estimated size 19.49 MB will generate 1 regions 2016-12-23 20:39:06,187 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 489 's estimated size 19.50 MB will generate 1 regions 2016-12-23 20:39:06,188 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 496 's estimated size 18.46 MB will generate 1 regions 2016-12-23 20:39:06,188 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 497 's estimated size 18.59 MB will generate 1 regions 2016-12-23 20:39:06,188 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 504 's estimated size 19.39 MB will generate 1 regions 2016-12-23 20:39:06,188 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 505 's estimated size 19.53 MB will generate 1 regions 2016-12-23 20:39:06,189 INFO [pool-8-thread-10] steps.CreateHTableJob:219 : Cuboid 511 's estimated size 19.63 MB will generate 1 regions 2016-12-23 20:39:06,189 INFO [pool-8-thread-10] steps.CreateHTableJob:232 : Region 0's estimated size is 576.78 MB, accounting for 100.00 percent 2016-12-23 20:39:06,190 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 137 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,190 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 136 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,190 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 1 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,190 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 129 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,190 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 8 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 128 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 9 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 393 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 256 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 392 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 257 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 385 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 264 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 265 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,191 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 384 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 201 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 64 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 200 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 65 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 193 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 72 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 192 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 73 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 457 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,192 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 320 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 456 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 321 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 449 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 328 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 448 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 329 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 511 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 504 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 369 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,193 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 505 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,194 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 368 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,194 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 96 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,194 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 233 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,194 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 97 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,194 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 232 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,194 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 496 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 377 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 497 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 376 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 104 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 225 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 224 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 105 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,195 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 489 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 352 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 488 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 353 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 113 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 248 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 112 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 249 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 481 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 360 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,196 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 480 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,197 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 361 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,197 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 121 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,197 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 240 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,197 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 120 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,197 INFO [pool-8-thread-10] common.CuboidShardUtil:41 : Cuboid 241 has 1 shards, skip saving it as an optimization 2016-12-23 20:39:06,198 INFO [pool-8-thread-10] cube.CubeManager:351 : Updating cube instance 'kylin_sales_cube' 2016-12-23 20:39:06,198 WARN [pool-8-thread-10] cube.CubeValidator:102 : NEW segment start does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:06,198 WARN [pool-8-thread-10] cube.CubeValidator:104 : NEW segment end does not fit/connect with other segments: kylin_sales_cube[20120101000000_20161201063000] 2016-12-23 20:39:06,222 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /cube/kylin_sales_cube.json from oldTs: 1482525544126, to newTs: 1482525546198, operation result: true 2016-12-23 20:39:06,223 INFO [pool-6-thread-1] cachesync.Broadcaster:122 : Announcing new broadcast event: BroadcastEvent{entity=cube, event=update, cacheKey=kylin_sales_cube} 2016-12-23 20:39:06,229 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube, listeners=[org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853] 2016-12-23 20:39:06,235 INFO [pool-8-thread-10] steps.CreateHTableJob:294 : hbase.hstore.compactionThreshold is 3 2016-12-23 20:39:06,235 INFO [pool-8-thread-10] steps.CreateHTableJob:302 : hfileSizeMB:576.0 2016-12-23 20:39:06,238 INFO [http-bio-7070-exec-5] cube.CubeManager:943 : Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 1 segments 2016-12-23 20:39:06,239 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:188 : Broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin, listeners=[org.apache.kylin.metadata.MetadataManager$SrcTableSyncListener@7bcd9b5b, org.apache.kylin.metadata.MetadataManager$SrcTableExtSyncListener@7792b2dc, org.apache.kylin.metadata.MetadataManager$DataModelSyncListener@401cc6d8, org.apache.kylin.metadata.MetadataManager$ExtFilterSyncListener@2142afca, org.apache.kylin.metadata.project.ProjectManager$ProjectSyncListener@398f1b41, org.apache.kylin.cube.CubeDescManager$CubeDescSyncListener@212307d5, org.apache.kylin.cube.CubeManager$CubeSyncListener@2d741f2, org.apache.kylin.rest.service.CacheService$1@22a7853, org.apache.kylin.storage.hybrid.HybridManager$HybridSyncListener@797bc6b6, org.apache.kylin.metadata.realization.RealizationRegistry$1@2d331509] 2016-12-23 20:39:06,239 INFO [http-bio-7070-exec-5] service.CacheService:138 : removeOLAPDataSource is called for project learn_kylin 2016-12-23 20:39:06,240 INFO [http-bio-7070-exec-5] service.CacheService:120 : cleaning cache for projectlearn_kylin (currently remove all entries) 2016-12-23 20:39:06,240 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=project_data, event=UPDATE, cacheKey=learn_kylin 2016-12-23 20:39:06,241 DEBUG [http-bio-7070-exec-5] cachesync.Broadcaster:218 : Done broadcasting metadata change: entity=cube, event=UPDATE, cacheKey=kylin_sales_cube 2016-12-23 20:39:06,288 INFO [pool-8-thread-10] compress.CodecPool:153 : Got brand-new compressor [.deflate] 2016-12-23 20:39:06,339 INFO [pool-8-thread-10] steps.CubeHTableUtil:189 : hbase will not use any compression algorithm to compress data 2016-12-23 20:39:06,341 INFO [pool-8-thread-10] steps.CubeHTableUtil:189 : hbase will not use any compression algorithm to compress data 2016-12-23 20:39:06,549 INFO [pool-8-thread-10] util.DeployCoprocessorCLI:188 : Add coprocessor on KYLIN_GO4NET77QR 2016-12-23 20:39:06,550 INFO [pool-8-thread-10] util.DeployCoprocessorCLI:168 : hbase table [B@69af70aa deployed with coprocessor. 2016-12-23 20:39:16,263 INFO [pool-8-thread-10] client.HBaseAdmin:755 : Created KYLIN_GO4NET77QR 2016-12-23 20:39:16,401 INFO [pool-8-thread-10] steps.CubeHTableUtil:107 : create hbase table KYLIN_GO4NET77QR done. 2016-12-23 20:39:16,468 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-05 2016-12-23 20:39:16,548 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-05 from oldTs: 1482525545596, to newTs: 1482525556469, operation result: true 2016-12-23 20:39:16,819 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-05 2016-12-23 20:39:16,938 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-05 from oldTs: 1482525556469, to newTs: 1482525556819, operation result: true 2016-12-23 20:39:16,939 INFO [pool-8-thread-10] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-05 from RUNNING to SUCCEED 2016-12-23 20:39:17,377 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:17,917 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525545514, to newTs: 1482525557378, operation result: true 2016-12-23 20:39:20,056 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:20,093 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525557378, to newTs: 1482525560057, operation result: true 2016-12-23 20:39:20,093 INFO [pool-8-thread-10] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from RUNNING to READY 2016-12-23 20:39:20,865 INFO [pool-7-thread-1] threadpool.DefaultScheduler:108 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} prepare to schedule 2016-12-23 20:39:20,865 INFO [pool-7-thread-1] threadpool.DefaultScheduler:112 : CubingJob{id=e32d3530-54b0-486a-96a3-024208cf6402, name=kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09, state=READY} scheduled 2016-12-23 20:39:20,866 INFO [pool-8-thread-10] execution.AbstractExecutable:99 : Executing AbstractExecutable (kylin_sales_cube - 20120101000000_20161201063000 - BUILD - GMT+08:00 2016-12-24 04:29:09) 2016-12-23 20:39:20,892 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 1 actual running, 1 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:39:21,076 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:21,318 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402 from oldTs: 1482525560057, to newTs: 1482525561077, operation result: true 2016-12-23 20:39:21,318 INFO [pool-8-thread-10] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402 from READY to RUNNING 2016-12-23 20:39:22,029 INFO [pool-8-thread-10] execution.AbstractExecutable:99 : Executing AbstractExecutable (Build Base Cuboid Data) 2016-12-23 20:39:22,048 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-06 2016-12-23 20:39:22,084 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-06 from oldTs: 1482524950151, to newTs: 1482525562048, operation result: true 2016-12-23 20:39:22,085 INFO [pool-8-thread-10] manager.ExecutableManager:292 : job id:e32d3530-54b0-486a-96a3-024208cf6402-06 from READY to RUNNING 2016-12-23 20:39:22,261 INFO [pool-8-thread-10] common.MapReduceExecutable:112 : parameters of the MapReduceExecutable: 2016-12-23 20:39:22,261 INFO [pool-8-thread-10] common.MapReduceExecutable:113 : -conf /database/install/kylin/conf/kylin_job_conf.xml -cubename kylin_sales_cube -segmentid dde159aa-cf41-4d76-af7b-9e095509cba6 -input FLAT_TABLE -output /kylin/kylin_metadata/kylin-e32d3530-54b0-486a-96a3-024208cf6402/kylin_sales_cube/cuboid/base_cuboid -jobname Kylin_Base_Cuboid_Builder_kylin_sales_cube -level 0 -cubingJobId e32d3530-54b0-486a-96a3-024208cf6402 2016-12-23 20:39:22,445 INFO [pool-8-thread-10] steps.CuboidJob:112 : Starting: Kylin_Base_Cuboid_Builder_kylin_sales_cube 2016-12-23 20:39:22,445 INFO [pool-8-thread-10] common.AbstractHadoopJob:163 : append job jar: /database/install/kylin/lib/kylin-job-1.6.0.jar 2016-12-23 20:39:22,445 INFO [pool-8-thread-10] common.AbstractHadoopJob:171 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-12-23 20:39:22,445 INFO [pool-8-thread-10] common.AbstractHadoopJob:188 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-12-23 20:39:22,446 INFO [pool-8-thread-10] common.AbstractHadoopJob:200 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 20:39:22,490 INFO [pool-8-thread-10] common.AbstractHadoopJob:202 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 20:39:22,490 INFO [pool-8-thread-10] common.AbstractHadoopJob:230 : Kafka Dependencies: 2016-12-23 20:39:22,529 INFO [pool-8-thread-10] common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-12-23 20:39:22,761 INFO [pool-8-thread-10] hive.metastore:382 : Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083 2016-12-23 20:39:22,763 INFO [pool-8-thread-10] hive.metastore:478 : Connected to metastore. 2016-12-23 20:39:23,513 INFO [pool-8-thread-10] common.KylinConfig:120 : The URI /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta is recognized as LOCAL_FOLDER 2016-12-23 20:39:23,514 INFO [pool-8-thread-10] common.KylinConfig:267 : New KylinConfig 1746944292 2016-12-23 20:39:23,514 INFO [pool-8-thread-10] common.KylinConfigBase:130 : Kylin Config was updated with kylin.metadata.url : /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta 2016-12-23 20:39:23,514 INFO [pool-8-thread-10] persistence.ResourceStore:80 : Using metadata url /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta for resource store 2016-12-23 20:39:23,542 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /cube/kylin_sales_cube.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,546 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /model_desc/kylin_sales_model.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,555 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /cube_desc/kylin_sales_cube_desc.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,777 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_CATEGORY_GROUPINGS.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,787 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_CAL_DT.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,805 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /table/DEFAULT.KYLIN_SALES.json (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,823 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_SALES/USER_ID/fca0f589-ba58-441d-a32c-5389ad24b4eb.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,836 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/CATEG_LVL2_NAME/62a1c81d-f928-4c48-a6f9-1c55d16ac853.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,844 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/SITE_ID/1114b595-d695-4592-9368-6acd235f857d.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,935 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/CATEG_LVL3_NAME/341eed0b-b83b-490d-b7ca-35d7061289d1.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,978 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_SALES/REGION/e317f02e-405a-4ecf-8d73-5de132ef9421.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,984 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_SALES/SELLER_ID/b7a82f33-7475-4ab2-8896-2b9e5e6cfd07.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,991 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/LEAF_CATEG_ID/5cb4714c-b84e-4673-a678-dfa1aaaa6560.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,998 DEBUG [pool-8-thread-10] persistence.ResourceStore:207 : Directly saving resource /dict/DEFAULT.KYLIN_CATEGORY_GROUPINGS/META_CATEG_NAME/6feb722a-b6cc-4984-a6c5-381a48f19364.dict (Store /database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta) 2016-12-23 20:39:23,998 INFO [pool-8-thread-10] common.AbstractHadoopJob:499 : HDFS meta dir is: file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta 2016-12-23 20:39:23,998 INFO [pool-8-thread-10] common.AbstractHadoopJob:372 : Job 'tmpfiles' updated -- file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta 2016-12-23 20:39:24,040 INFO [pool-8-thread-10] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:39:24,041 INFO [pool-8-thread-10] Configuration.deprecation:1173 : mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 2016-12-23 20:39:24,041 INFO [pool-8-thread-10] steps.CuboidJob:205 : Having total map input MB 0 2016-12-23 20:39:24,041 INFO [pool-8-thread-10] steps.CuboidJob:206 : Having level 0, pre-level cuboids 1, this level cuboids 1 2016-12-23 20:39:24,042 INFO [pool-8-thread-10] steps.CuboidJob:207 : Having per reduce MB 500.0, reduce count ratio 1.0 2016-12-23 20:39:24,042 INFO [pool-8-thread-10] steps.CuboidJob:208 : Setting mapred.reduce.tasks=1 2016-12-23 20:39:24,547 INFO [pool-8-thread-10] impl.TimelineClientImpl:352 : Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-12-23 20:39:24,547 INFO [pool-8-thread-10] client.RMProxy:98 : Connecting to ResourceManager at sandbox.hortonworks.com/192.168.150.148:8050 2016-12-23 20:39:29,242 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 1 should running, 1 actual running, 0 ready, 2 already succeed, 0 error, 0 discarded, 0 others 2016-12-23 20:39:37,550 INFO [pool-8-thread-10] mapred.FileInputFormat:249 : Total input paths to process : 1 2016-12-23 20:39:37,818 INFO [pool-8-thread-10] mapreduce.JobSubmitter:198 : number of splits:1 2016-12-23 20:39:38,179 INFO [pool-8-thread-10] mapreduce.JobSubmitter:287 : Submitting tokens for job: job_1482519724635_0012 2016-12-23 20:39:38,760 INFO [pool-8-thread-10] impl.YarnClientImpl:274 : Submitted application application_1482519724635_0012 2016-12-23 20:39:38,855 INFO [pool-8-thread-10] mapreduce.Job:1294 : The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1482519724635_0012/ 2016-12-23 20:39:38,855 INFO [pool-8-thread-10] common.AbstractHadoopJob:506 : tempMetaFileString is : file:///database/install/kylin/bin/../tomcat/temp/kylin_job_meta6749565651291800597/meta 2016-12-23 20:39:38,893 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-06 2016-12-23 20:39:38,964 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-06 from oldTs: 1482525562048, to newTs: 1482525578893, operation result: true 2016-12-23 20:39:48,994 DEBUG [pool-8-thread-10] dao.ExecutableDao:210 : updating job output, id: e32d3530-54b0-486a-96a3-024208cf6402-06 2016-12-23 20:39:49,251 DEBUG [pool-8-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/e32d3530-54b0-486a-96a3-024208cf6402-06 from oldTs: 1482525578893, to newTs: 1482525588994, operation result: true