2016-08-15 03:03:17,130 INFO [localhost-startStop-1] core.SpringSecurityCoreVersion:33 : You are running with Spring Security Core 3.1.2.RELEASE 2016-08-15 03:03:17,135 INFO [localhost-startStop-1] config.SecurityNamespaceHandler:59 : Spring Security 'config' module version is 3.1.2.RELEASE 2016-08-15 03:03:17,169 INFO [localhost-startStop-1] method.GlobalMethodSecurityBeanDefinitionParser:141 : Using bean 'expressionHandler' as method ExpressionHandler implementation 2016-08-15 03:03:17,258 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/user/authentication*/** 2016-08-15 03:03:17,258 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/query*/** 2016-08-15 03:03:17,259 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/metadata*/** 2016-08-15 03:03:17,259 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/**/metrics 2016-08-15 03:03:17,259 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/cache*/** 2016-08-15 03:03:17,259 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasAnyRole('ROLE_ANALYST')' for /api/cubes/src/tables 2016-08-15 03:03:17,260 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/cubes*/** 2016-08-15 03:03:17,260 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/models*/** 2016-08-15 03:03:17,261 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/streaming*/** 2016-08-15 03:03:17,261 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/job*/** 2016-08-15 03:03:17,261 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/admin/config 2016-08-15 03:03:17,262 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/projects 2016-08-15 03:03:17,262 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasRole('ROLE_ADMIN')' for /api/admin*/** 2016-08-15 03:03:17,266 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/** 2016-08-15 03:03:17,293 INFO [localhost-startStop-1] http.AuthenticationConfigBuilder:465 : No login page configured. The default internal one will be used. Use the 'login-page' attribute to set the URL of the login page. 2016-08-15 03:03:17,301 INFO [localhost-startStop-1] http.HttpSecurityBeanDefinitionParser:264 : Checking sorted filter chain: [Root bean: class [org.springframework.security.web.context.SecurityContextPersistenceFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 300, Root bean: class [org.springframework.security.web.authentication.logout.LogoutFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 400, , order = 800, Root bean: class [org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1000, Root bean: class [org.springframework.security.web.authentication.www.BasicAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1200, Root bean: class [org.springframework.security.web.savedrequest.RequestCacheAwareFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1300, Root bean: class [org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1400, Root bean: class [org.springframework.security.web.authentication.AnonymousAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1700, Root bean: class [org.springframework.security.web.session.SessionManagementFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1800, Root bean: class [org.springframework.security.web.access.ExceptionTranslationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1900, , order = 2000] 2016-08-15 03:03:17,920 WARN [localhost-startStop-1] common.KylinConfig:163 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2016-08-15 03:03:18,035 INFO [localhost-startStop-1] security.PasswordPlaceholderConfigurer:177 : Loading properties file from resource loaded through InputStream 2016-08-15 03:03:19,079 INFO [localhost-startStop-1] util.Version:27 : HV000001: Hibernate Validator 5.1.3.Final 2016-08-15 03:03:20,393 INFO [localhost-startStop-1] init.InitialTaskManager:36 : Kylin service is starting..... 2016-08-15 03:03:21,335 INFO [localhost-startStop-1] controller.JobController:83 : Initializing Job Engine .... 2016-08-15 03:03:21,372 INFO [Thread-4] manager.ExecutableManager:73 : Using metadata url: kylin_metadata@hbase 2016-08-15 03:03:21,381 INFO [Thread-4] dao.ExecutableDao:65 : Using metadata url: kylin_metadata@hbase 2016-08-15 03:03:21,402 INFO [Thread-4] persistence.ResourceStore:82 : Using metadata url kylin_metadata@hbase for resource store 2016-08-15 03:03:21,549 INFO [localhost-startStop-1] filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM argument net.sf.ehcache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$ 2016-08-15 03:03:21,576 INFO [localhost-startStop-1] sizeof.JvmInformation:545 : Detected JVM data model settings of: Unrecognized 64-Bit JVM 2016-08-15 03:03:21,754 INFO [Thread-4] hbase.HBaseConnection:142 : connection is null or closed, creating a new one 2016-08-15 03:03:21,846 INFO [localhost-startStop-1] sizeof.AgentLoader:197 : Extracted agent jar to temporary file bin/../tomcat/temp/ehcache-sizeof-agent3006977542848772380.jar 2016-08-15 03:03:21,846 INFO [localhost-startStop-1] sizeof.AgentLoader:137 : Trying to load agent @ bin/../tomcat/temp/ehcache-sizeof-agent3006977542848772380.jar 2016-08-15 03:03:21,862 INFO [localhost-startStop-1] impl.DefaultSizeOfEngine:113 : using Agent sizeof engine 2016-08-15 03:03:22,211 INFO [localhost-startStop-1] cube.CubeManager:122 : Initializing CubeManager with config kylin_metadata@hbase 2016-08-15 03:03:24,433 DEBUG [Thread-4] hbase.HBaseConnection:188 : HTable 'kylin_metadata' already exists 2016-08-15 03:03:24,446 DEBUG [Thread-4] metadata.MetadataManager:311 : Reloading SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase 2016-08-15 03:03:24,601 DEBUG [localhost-startStop-1] cube.CubeManager:817 : Loading Cube from folder kylin_metadata(key='/cube')@kylin_metadata@hbase 2016-08-15 03:03:24,768 INFO [localhost-startStop-1] cube.CubeDescManager:91 : Initializing CubeDescManager with config kylin_metadata@hbase 2016-08-15 03:03:24,769 INFO [localhost-startStop-1] cube.CubeDescManager:197 : Reloading Cube Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase 2016-08-15 03:03:24,910 DEBUG [Thread-4] metadata.MetadataManager:320 : Loaded 16 SourceTable(s) 2016-08-15 03:03:24,910 DEBUG [Thread-4] metadata.MetadataManager:252 : Reloading SourceTable exd info from folder kylin_metadata(key='/table_exd')@kylin_metadata@hbase 2016-08-15 03:03:25,123 DEBUG [Thread-4] metadata.MetadataManager:261 : Loaded 14 SourceTable EXD(s) 2016-08-15 03:03:25,123 DEBUG [Thread-4] metadata.MetadataManager:427 : Reloading DataModel from folder kylin_metadata(key='/model_desc')@kylin_metadata@hbase 2016-08-15 03:03:25,227 DEBUG [Thread-4] metadata.MetadataManager:441 : Loaded 6 DataModel(s) 2016-08-15 03:03:25,227 DEBUG [Thread-4] metadata.MetadataManager:297 : Reloading ExternalFilter from folder kylin_metadata(key='/ext_filter')@kylin_metadata@hbase 2016-08-15 03:03:25,236 DEBUG [Thread-4] metadata.MetadataManager:306 : Loaded 0 SourceTable(s) 2016-08-15 03:03:25,292 DEBUG [localhost-startStop-1] cube.CubeDescManager:222 : Loaded 6 Cube(s) 2016-08-15 03:03:25,303 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Product_Cube with reference beingCUBE[name=Product_Cube] having 0 segments: 2016-08-15 03:03:25,308 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Product_Cube_1 with reference beingCUBE[name=Product_Cube_1] having 0 segments: 2016-08-15 03:03:25,319 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Product_Cube_2 with reference beingCUBE[name=Product_Cube_2] having 1 segments:KYLIN_OOYQPKPUSV 2016-08-15 03:03:25,328 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 9 segments:KYLIN_ZMMVWYPF3J,KYLIN_SZTO65778I,KYLIN_BG8CUM0BJF,KYLIN_YKRP5S2FGC,KYLIN_3HZ1WJ2VVU,KYLIN_KEGB65APJB,KYLIN_O1SQYHSM1B,KYLIN_1VKVO9BU8D,KYLIN_N2XGAESKY0 2016-08-15 03:03:25,338 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_ZYW9RTGGF0 2016-08-15 03:03:25,345 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: kylin_sales_cube with reference beingCUBE[name=kylin_sales_cube] having 0 segments: 2016-08-15 03:03:25,345 DEBUG [localhost-startStop-1] cube.CubeManager:823 : Loaded 6 Cube(s) 2016-08-15 03:03:25,431 INFO [localhost-startStop-1] badquery.BadQueryHistoryManager:42 : Initializing BadQueryHistoryManager with config kylin_metadata@hbase 2016-08-15 03:03:26,968 INFO [localhost-startStop-1] web.DefaultSecurityFilterChain:28 : Creating filter chain: org.springframework.security.web.util.AnyRequestMatcher@1, [org.springframework.security.web.context.SecurityContextPersistenceFilter@41a263c5, org.springframework.security.web.authentication.logout.LogoutFilter@c443c2d, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@53cab4a5, org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter@2119e79d, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@2bb50565, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@7975404d, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@d0bd87, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@84aea7c, org.springframework.security.web.session.SessionManagementFilter@6e687724, org.springframework.security.web.access.ExceptionTranslationFilter@c66151d, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@1f42947] 2016-08-15 03:03:36,091 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:04:00,608 DEBUG [http-bio-7070-exec-3] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:04:02,046 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:04:02,380 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:04:02,458 INFO [http-bio-7070-exec-8] project.ProjectManager:88 : Initializing ProjectManager with metadata url kylin_metadata@hbase 2016-08-15 03:04:02,538 DEBUG [http-bio-7070-exec-8] project.ProjectManager:104 : Loading Project from folder kylin_metadata(key='/project')@kylin_metadata@hbase 2016-08-15 03:04:02,563 DEBUG [http-bio-7070-exec-8] project.ProjectManager:109 : Loaded 5 Project(s) 2016-08-15 03:04:02,564 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:04:10,960 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:04:10,960 INFO [http-bio-7070-exec-8] realization.RealizationRegistry:75 : Initializing RealizationRegistry with metadata url kylin_metadata@hbase 2016-08-15 03:04:11,772 INFO [http-bio-7070-exec-8] reflections.Reflections:224 : Reflections took 776 ms to scan 18 urls, producing 278 keys and 2186 values 2016-08-15 03:04:11,783 INFO [http-bio-7070-exec-8] invertedindex.IIManager:101 : Initializing IIManager with config kylin_metadata@hbase 2016-08-15 03:04:11,790 DEBUG [http-bio-7070-exec-8] invertedindex.IIManager:226 : Loading II from folder kylin_metadata(key='/invertedindex')@kylin_metadata@hbase 2016-08-15 03:04:11,791 DEBUG [http-bio-7070-exec-8] invertedindex.IIManager:232 : Loaded 0 II(s) 2016-08-15 03:04:11,793 INFO [http-bio-7070-exec-8] hybrid.HybridManager:82 : Initializing HybridManager with config kylin_metadata@hbase 2016-08-15 03:04:11,802 DEBUG [http-bio-7070-exec-8] hybrid.HybridManager:92 : Loading Hybrid from folder kylin_metadata(key='/hybrid')@kylin_metadata@hbase 2016-08-15 03:04:11,803 DEBUG [http-bio-7070-exec-8] hybrid.HybridManager:98 : Loaded 0 Hybrid(s) 2016-08-15 03:04:11,803 INFO [http-bio-7070-exec-8] realization.RealizationRegistry:103 : RealizationRegistry is {HYBRID=org.apache.kylin.storage.hybrid.HybridManager@63be00f5, INVERTED_INDEX=org.apache.kylin.invertedindex.IIManager@4f3107fb, CUBE=org.apache.kylin.cube.CubeManager@f340cbb} 2016-08-15 03:04:11,805 INFO [http-bio-7070-exec-5] controller.TableController:95 : Return all table metadata in 845 seconds 2016-08-15 03:04:14,937 INFO [http-bio-7070-exec-7] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 03:04:15,057 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471051694400, to newTs: 1471230254938, operation result: true 2016-08-15 03:04:15,061 DEBUG [http-bio-7070-exec-7] restclient.Broadcaster:88 : 1 nodes in the cluster: [localhost:7070] 2016-08-15 03:04:15,078 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 9 segments:KYLIN_ZMMVWYPF3J,KYLIN_SZTO65778I,KYLIN_BG8CUM0BJF,KYLIN_YKRP5S2FGC,KYLIN_3HZ1WJ2VVU,KYLIN_KEGB65APJB,KYLIN_O1SQYHSM1B,KYLIN_1VKVO9BU8D,KYLIN_N2XGAESKY0 2016-08-15 03:04:15,090 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:04:15,093 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:04:15,099 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:04:15,100 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 03:04:15,100 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:04:15,102 DEBUG [http-bio-7070-exec-7] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 03:04:15,102 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:04:15,114 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 03:04:15,214 INFO [http-bio-7070-exec-1] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:04:15,216 INFO [http-bio-7070-exec-1] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:04:15,224 DEBUG [http-bio-7070-exec-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 9 segments:KYLIN_ZMMVWYPF3J,KYLIN_SZTO65778I,KYLIN_BG8CUM0BJF,KYLIN_YKRP5S2FGC,KYLIN_3HZ1WJ2VVU,KYLIN_KEGB65APJB,KYLIN_O1SQYHSM1B,KYLIN_1VKVO9BU8D,KYLIN_N2XGAESKY0 2016-08-15 03:04:15,229 INFO [http-bio-7070-exec-1] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:04:15,229 INFO [http-bio-7070-exec-1] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:04:15,230 DEBUG [http-bio-7070-exec-1] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:04:15,231 DEBUG [http-bio-7070-exec-1] service.CubeService:591 : server mode: all 2016-08-15 03:04:15,231 INFO [http-bio-7070-exec-1] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:04:15,232 DEBUG [http-bio-7070-exec-1] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 03:04:15,232 DEBUG [http-bio-7070-exec-1] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:04:18,806 INFO [http-bio-7070-exec-2] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 03:04:18,814 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471230254938, to newTs: 1471230258806, operation result: true 2016-08-15 03:04:18,815 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/2187b737-546d-4bd0-9594-9b803b0c32af.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,822 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/fe10fa5b-b93a-4e1f-8215-172efdb58d71.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,826 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/60a48fd3-fe47-400a-afd3-28e7ab1a36ec.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,831 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/16122d60-ee8a-4090-871a-52b448c35e86.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,834 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/8cd62a7e-8a02-48ea-801e-03f803f89a5c.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,838 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/dc181ca3-f3f1-433b-9215-ebf74d78795b.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,841 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/3ecfa82c-77c2-46c0-acc9-cfc52143a938.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,848 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/47ccbbe2-d589-4bbc-aad2-1460f827860a.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,852 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/065bb1c9-f2ab-43d6-9fdf-df79a9f54bbf.seq (Store kylin_metadata@hbase) 2016-08-15 03:04:18,855 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 03:04:18,859 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 0 segments: 2016-08-15 03:04:18,864 INFO [http-bio-7070-exec-1] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:04:18,864 INFO [http-bio-7070-exec-1] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:04:18,864 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:04:18,865 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:04:18,865 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:04:18,866 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 03:04:18,866 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:04:18,867 DEBUG [http-bio-7070-exec-2] cube.CubeManager:639 : Cube Streaming_Cube has no ready segment to merge 2016-08-15 03:04:18,867 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:04:18,868 DEBUG [http-bio-7070-exec-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 0 segments: 2016-08-15 03:04:18,872 INFO [http-bio-7070-exec-1] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:04:18,873 INFO [http-bio-7070-exec-1] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:04:18,873 DEBUG [http-bio-7070-exec-1] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:04:18,873 DEBUG [http-bio-7070-exec-1] service.CubeService:591 : server mode: all 2016-08-15 03:04:18,873 INFO [http-bio-7070-exec-1] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:04:18,874 DEBUG [http-bio-7070-exec-1] cube.CubeManager:639 : Cube Streaming_Cube has no ready segment to merge 2016-08-15 03:04:18,874 DEBUG [http-bio-7070-exec-1] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:04:36,149 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:05:36,032 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:06:36,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:07:36,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:08:36,042 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:09:36,034 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:10:15,908 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:10:15,942 DEBUG [http-bio-7070-exec-4] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:10:16,077 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:10:16,300 INFO [http-bio-7070-exec-1] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:10:16,309 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 10 seconds 2016-08-15 03:10:18,021 INFO [http-bio-7070-exec-9] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:10:18,022 INFO [http-bio-7070-exec-9] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:10:18,025 DEBUG [http-bio-7070-exec-9] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_5JWYRGU1QL 2016-08-15 03:10:18,029 INFO [http-bio-7070-exec-9] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:10:18,031 INFO [http-bio-7070-exec-9] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:10:18,031 DEBUG [http-bio-7070-exec-9] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:10:18,031 DEBUG [http-bio-7070-exec-9] service.CubeService:591 : server mode: all 2016-08-15 03:10:18,031 INFO [http-bio-7070-exec-9] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:10:18,032 DEBUG [http-bio-7070-exec-9] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:10:36,041 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:11:36,035 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:12:36,159 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:13:36,031 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:14:36,046 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:15:36,044 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:16:36,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:17:36,066 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:18:36,071 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:18:47,468 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:18:47,491 DEBUG [http-bio-7070-exec-7] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:18:47,626 DEBUG [http-bio-7070-exec-7] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:18:47,737 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:18:47,737 INFO [http-bio-7070-exec-5] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 03:19:36,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:19:36,871 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_5JWYRGU1QL". 2016-08-15 03:19:43,060 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:19:43,116 DEBUG [http-bio-7070-exec-8] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 03:19:43,139 INFO [http-bio-7070-exec-8] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "", "schemas": [ ] } 2016-08-15 03:19:43,140 DEBUG [http-bio-7070-exec-8] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "", "schemas": [ ] } 2016-08-15 03:19:43,395 DEBUG [http-bio-7070-exec-8] service.QueryService:291 : getting table metas 2016-08-15 03:19:43,497 DEBUG [http-bio-7070-exec-8] service.QueryService:309 : getting column metas 2016-08-15 03:19:43,547 DEBUG [http-bio-7070-exec-8] service.QueryService:323 : done column metas 2016-08-15 03:20:06,362 INFO [http-bio-7070-exec-1] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:20:06,381 INFO [http-bio-7070-exec-1] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 03:20:06,403 INFO [http-bio-7070-exec-1] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 03:20:06,989 ERROR [http-bio-7070-exec-1] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000": From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:106) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2757) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2742) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2960) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 80 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table 'STREAMING_SALES_TABLE' not found at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 107 more 2016-08-15 03:20:07,002 INFO [http-bio-7070-exec-1] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000": From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found ==========================[QUERY]=============================== 2016-08-15 03:20:07,009 ERROR [http-bio-7070-exec-1] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000": From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:20:17,064 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:20:17,296 DEBUG [http-bio-7070-exec-2] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:20:17,442 DEBUG [http-bio-7070-exec-4] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:20:17,630 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 03:20:23,901 INFO [http-bio-7070-exec-4] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 03:20:23,906 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471230617795, to newTs: 1471231223901, operation result: true 2016-08-15 03:20:23,907 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 03:20:23,914 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_5JWYRGU1QL 2016-08-15 03:20:23,917 INFO [http-bio-7070-exec-1] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:20:23,918 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:20:23,918 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:20:23,918 INFO [http-bio-7070-exec-1] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:20:23,919 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:20:23,920 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 03:20:23,921 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:20:23,921 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:20:23,923 DEBUG [http-bio-7070-exec-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_5JWYRGU1QL 2016-08-15 03:20:23,928 INFO [http-bio-7070-exec-1] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:20:23,929 INFO [http-bio-7070-exec-1] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:20:23,929 DEBUG [http-bio-7070-exec-1] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:20:23,930 DEBUG [http-bio-7070-exec-1] service.CubeService:591 : server mode: all 2016-08-15 03:20:23,930 INFO [http-bio-7070-exec-1] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:20:23,931 DEBUG [http-bio-7070-exec-1] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:20:26,414 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:20:26,414 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 03:20:26,415 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 03:20:26,415 DEBUG [http-bio-7070-exec-10] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 03:20:26,415 INFO [http-bio-7070-exec-10] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:20:26,416 INFO [http-bio-7070-exec-10] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 03:20:26,418 DEBUG [http-bio-7070-exec-10] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 03:20:26,895 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:20:26,897 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@5e8a2464 2016-08-15 03:20:26,904 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:20:26,905 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:20:26,905 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:20:27,355 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:20:27,376 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:20:27,403 INFO [http-bio-7070-exec-10] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict 2016-08-15 03:20:27,450 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815030000_20160815030500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:20:27,470 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 266 bytes, rawScanBytesString 46 bytes 2016-08-15 03:20:27,471 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 34b38fbe for segment Streaming_Cube[20160815030000_20160815030500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:20:27,472 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_5JWYRGU1QL: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:20:27,473 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:20:27,691 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:20:27,720 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:20:27,912 INFO [pool-8-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_5JWYRGU1QL Shard \x4B\x59\x4C\x49\x4E\x5F\x35\x4A\x57\x59\x52\x47\x55\x31\x51\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x30\x36\x30\x36\x32\x35\x32\x2E\x35\x63\x66\x39\x61\x33\x39\x30\x65\x36\x35\x37\x35\x66\x36\x64\x66\x32\x64\x36\x30\x31\x37\x66\x32\x36\x39\x66\x63\x62\x64\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 2. Total filtered/aggred row: 0. Time elapsed in EP: 90(ms). Server CPU usage: 0.17427484168380158, server physical mem left: 2.72437248E8, server swap mem left:4.81521664E9.Etc message: start latency: 100@65,agg done@85,compress done@87,server stats done@88, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:20:27,914 DEBUG [pool-8-thread-1] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 03:20:27,916 INFO [pool-8-thread-2] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_5JWYRGU1QL Shard \x4B\x59\x4C\x49\x4E\x5F\x35\x4A\x57\x59\x52\x47\x55\x31\x51\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x30\x36\x30\x36\x32\x35\x32\x2E\x35\x63\x66\x39\x61\x33\x39\x30\x65\x36\x35\x37\x35\x66\x36\x64\x66\x32\x64\x36\x30\x31\x37\x66\x32\x36\x39\x66\x63\x62\x64\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 2. Total filtered/aggred row: 0. Time elapsed in EP: 90(ms). Server CPU usage: 0.0, server physical mem left: 2.72437248E8, server swap mem left:4.81521664E9.Etc message: start latency: 100@65,agg done@86,compress done@87,server stats done@89, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:20:27,918 DEBUG [pool-8-thread-2] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 03:20:27,938 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 2, 2016-08-15 03:20:27,942 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 1528, total scan count 2 2016-08-15 03:20:27,943 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 1.528 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 2 Result row count: 2 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:20:36,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:21:03,517 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:21:07,364 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:21:07,438 DEBUG [http-bio-7070-exec-4] service.QueryService:291 : getting table metas 2016-08-15 03:21:07,440 DEBUG [http-bio-7070-exec-4] service.QueryService:309 : getting column metas 2016-08-15 03:21:07,445 DEBUG [http-bio-7070-exec-4] service.QueryService:323 : done column metas 2016-08-15 03:21:13,843 INFO [http-bio-7070-exec-2] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 03:21:13,853 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471231223901, to newTs: 1471231273844, operation result: true 2016-08-15 03:21:13,853 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 03:21:13,857 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:21:13,857 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:21:13,859 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_5JWYRGU1QL 2016-08-15 03:21:13,868 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:21:13,868 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:21:13,869 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:21:13,869 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 03:21:13,870 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:21:13,868 DEBUG [http-bio-7070-exec-6] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_5JWYRGU1QL 2016-08-15 03:21:13,870 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:21:13,873 INFO [http-bio-7070-exec-6] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:21:13,873 INFO [http-bio-7070-exec-6] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:21:13,874 DEBUG [http-bio-7070-exec-6] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:21:13,874 DEBUG [http-bio-7070-exec-6] service.CubeService:591 : server mode: all 2016-08-15 03:21:13,874 INFO [http-bio-7070-exec-6] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:21:13,874 DEBUG [http-bio-7070-exec-6] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:21:28,581 INFO [http-bio-7070-exec-4] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 03:21:28,587 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471231273844, to newTs: 1471231288582, operation result: true 2016-08-15 03:21:28,588 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/955b2da0-8b7d-4fda-b681-9f410e3fdd79.seq (Store kylin_metadata@hbase) 2016-08-15 03:21:28,595 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 03:21:28,601 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:21:28,602 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:21:28,603 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 0 segments: 2016-08-15 03:21:28,609 DEBUG [http-bio-7070-exec-6] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 0 segments: 2016-08-15 03:21:28,613 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:21:28,613 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:21:28,614 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:21:28,615 INFO [http-bio-7070-exec-6] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:21:28,615 INFO [http-bio-7070-exec-6] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:21:28,616 DEBUG [http-bio-7070-exec-6] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:21:28,616 DEBUG [http-bio-7070-exec-6] service.CubeService:591 : server mode: all 2016-08-15 03:21:28,616 INFO [http-bio-7070-exec-6] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:21:28,616 DEBUG [http-bio-7070-exec-6] cube.CubeManager:639 : Cube Streaming_Cube has no ready segment to merge 2016-08-15 03:21:28,616 DEBUG [http-bio-7070-exec-6] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:21:28,617 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 03:21:28,618 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:21:28,618 DEBUG [http-bio-7070-exec-4] cube.CubeManager:639 : Cube Streaming_Cube has no ready segment to merge 2016-08-15 03:21:28,619 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:21:36,027 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:22:36,060 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:23:36,099 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:24:36,038 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:25:36,029 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:26:36,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:27:36,022 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:27:50,684 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:27:50,726 DEBUG [http-bio-7070-exec-3] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:27:50,849 DEBUG [http-bio-7070-exec-9] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:27:50,972 INFO [http-bio-7070-exec-7] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:27:50,976 INFO [http-bio-7070-exec-7] controller.TableController:95 : Return all table metadata in 4 seconds 2016-08-15 03:28:36,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:29:36,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:30:25,659 INFO [http-bio-7070-exec-5] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:30:25,666 INFO [http-bio-7070-exec-5] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:30:25,670 DEBUG [http-bio-7070-exec-5] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_3ST7A64L6P 2016-08-15 03:30:25,674 INFO [http-bio-7070-exec-5] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:30:25,674 INFO [http-bio-7070-exec-5] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:30:25,675 DEBUG [http-bio-7070-exec-5] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:30:25,676 DEBUG [http-bio-7070-exec-5] service.CubeService:591 : server mode: all 2016-08-15 03:30:25,676 INFO [http-bio-7070-exec-5] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:30:25,676 DEBUG [http-bio-7070-exec-5] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:30:36,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:31:36,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:32:36,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:33:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:33:43,149 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:33:43,170 DEBUG [http-bio-7070-exec-1] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:33:43,286 DEBUG [http-bio-7070-exec-5] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:33:43,387 INFO [http-bio-7070-exec-3] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:33:43,388 INFO [http-bio-7070-exec-3] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 03:33:49,590 INFO [http-bio-7070-exec-4] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 03:33:49,599 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471231825421, to newTs: 1471232029590, operation result: true 2016-08-15 03:33:49,600 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 03:33:49,603 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_3ST7A64L6P 2016-08-15 03:33:49,606 INFO [http-bio-7070-exec-10] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 03:33:49,607 INFO [http-bio-7070-exec-10] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 03:33:49,607 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:33:49,608 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:33:49,610 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:33:49,610 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 03:33:49,612 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:33:49,612 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:33:49,611 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_3ST7A64L6P 2016-08-15 03:33:49,616 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 03:33:49,617 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 03:33:49,617 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 03:33:49,618 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 03:33:49,618 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 03:33:49,618 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 03:34:06,379 INFO [http-bio-7070-exec-8] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:34:06,381 INFO [http-bio-7070-exec-8] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 03:34:06,382 INFO [http-bio-7070-exec-8] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 03:34:06,382 DEBUG [http-bio-7070-exec-8] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 03:34:06,382 INFO [http-bio-7070-exec-8] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 03:34:06,385 INFO [http-bio-7070-exec-8] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 03:34:06,385 DEBUG [http-bio-7070-exec-8] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 03:34:06,463 INFO [http-bio-7070-exec-8] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:34:06,463 INFO [http-bio-7070-exec-8] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@7fc07b32 2016-08-15 03:34:06,464 INFO [http-bio-7070-exec-8] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:34:06,464 INFO [http-bio-7070-exec-8] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:34:06,464 INFO [http-bio-7070-exec-8] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:34:06,543 DEBUG [http-bio-7070-exec-8] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:34:06,543 INFO [http-bio-7070-exec-8] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:34:06,544 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:34:06,545 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 266 bytes, rawScanBytesString 46 bytes 2016-08-15 03:34:06,545 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 20ffd4e9 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:34:06,546 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:34:06,546 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:34:06,629 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:34:06,630 DEBUG [http-bio-7070-exec-8] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:34:06,652 INFO [pool-8-thread-4] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 11(ms). Server CPU usage: 0.06518438586145024, server physical mem left: 7.33556736E8, server swap mem left:4.444946432E9.Etc message: start latency: 8@9,agg done@10,compress done@11,server stats done@11, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:34:06,652 DEBUG [pool-8-thread-4] util.CompressionUtils:67 : Original: 26 bytes. Decompressed: 25 bytes. Time: 0 2016-08-15 03:34:06,653 INFO [pool-8-thread-3] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 1.0, server physical mem left: 7.33556736E8, server swap mem left:4.444946432E9.Etc message: start latency: 8@10,agg done@12,compress done@12,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:34:06,660 DEBUG [pool-8-thread-3] util.CompressionUtils:67 : Original: 26 bytes. Decompressed: 25 bytes. Time: 0 2016-08-15 03:34:06,660 INFO [http-bio-7070-exec-8] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 03:34:06,660 INFO [http-bio-7070-exec-8] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 278, total scan count 5 2016-08-15 03:34:06,661 INFO [http-bio-7070-exec-8] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.278 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:34:31,012 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:34:31,047 DEBUG [http-bio-7070-exec-8] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:34:31,183 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:34:31,339 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 03:34:33,405 INFO [http-bio-7070-exec-5] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_3ST7A64L6P". 2016-08-15 03:34:36,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:35:36,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:36:36,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:37:36,016 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:38:36,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:39:36,018 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:40:36,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:41:06,941 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:41:06,992 DEBUG [http-bio-7070-exec-1] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:41:07,089 DEBUG [http-bio-7070-exec-5] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:41:07,333 DEBUG [http-bio-7070-exec-7] service.QueryService:291 : getting table metas 2016-08-15 03:41:07,339 DEBUG [http-bio-7070-exec-7] service.QueryService:309 : getting column metas 2016-08-15 03:41:07,347 DEBUG [http-bio-7070-exec-7] service.QueryService:323 : done column metas 2016-08-15 03:41:24,473 DEBUG [http-bio-7070-exec-10] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:41:24,478 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:41:24,611 DEBUG [http-bio-7070-exec-3] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:41:24,752 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 03:41:32,730 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:41:36,089 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:41:40,058 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:42:36,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:42:42,655 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:42:42,656 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select * from streaming_sales_table where device = 'Other' order by minute_start 2016-08-15 03:42:42,657 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select * from streaming_sales_table where device = 'Other' order by minute_start LIMIT 50000 2016-08-15 03:42:42,905 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:42:42,906 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@1eea53e4 2016-08-15 03:42:42,907 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:42:42,908 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:42:42,908 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:42:42,979 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:42:42,982 INFO [http-bio-7070-exec-5] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:42:42,983 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:42:42,984 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict 2016-08-15 03:42:42,993 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict 2016-08-15 03:42:42,996 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict 2016-08-15 03:42:43,000 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict 2016-08-15 03:42:43,003 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict 2016-08-15 03:42:43,010 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict 2016-08-15 03:42:43,024 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:42:43,025 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1186 bytes, rawScanBytesString 120 bytes 2016-08-15 03:42:43,026 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 767fce14 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:42:43,029 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00\x00\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x01\x01\x01\x00\x01\x01\x01\x01\x01\x01\x01; 2016-08-15 03:42:43,030 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:42:43,118 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:42:43,119 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:42:43,162 INFO [pool-8-thread-5] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 39. Total filtered/aggred row: 0. Time elapsed in EP: 35(ms). Server CPU usage: 0.04826546003016591, server physical mem left: 4.84794368E8, server swap mem left:4.4555264E9.Etc message: start latency: 6@6,agg done@35,compress done@35,server stats done@35, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:42:43,163 DEBUG [pool-8-thread-5] util.CompressionUtils:67 : Original: 357 bytes. Decompressed: 819 bytes. Time: 0 2016-08-15 03:42:43,163 INFO [pool-8-thread-6] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 39. Total filtered/aggred row: 0. Time elapsed in EP: 37(ms). Server CPU usage: 0.0, server physical mem left: 4.84794368E8, server swap mem left:4.4555264E9.Etc message: start latency: 6@6,agg done@37,compress done@37,server stats done@37, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:42:43,164 DEBUG [pool-8-thread-6] util.CompressionUtils:67 : Original: 357 bytes. Decompressed: 819 bytes. Time: 0 2016-08-15 03:42:43,181 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 39, 2016-08-15 03:42:43,182 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 526, total scan count 39 2016-08-15 03:42:43,182 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table where device = 'Other' order by minute_start User: ADMIN Success: true Duration: 0.526 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 39 Result row count: 39 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:42:51,904 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:42:51,904 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select * from streaming_sales_table where device = 'Other' order by minute_start desc 2016-08-15 03:42:51,905 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select * from streaming_sales_table where device = 'Other' order by minute_start desc LIMIT 50000 2016-08-15 03:42:51,999 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:42:52,000 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@150af46 2016-08-15 03:42:52,000 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:42:52,001 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:42:52,001 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:42:52,048 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:42:52,049 INFO [http-bio-7070-exec-5] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:42:52,050 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:42:52,053 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:42:52,055 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1186 bytes, rawScanBytesString 120 bytes 2016-08-15 03:42:52,055 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 2c8cc69f for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:42:52,058 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x01\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00\x00\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x01\x01\x01\x00\x01\x01\x01\x01\x01\x01\x01; 2016-08-15 03:42:52,059 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:42:52,059 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:42:52,060 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:42:52,076 INFO [pool-8-thread-5] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 39. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 0.03098106712564544, server physical mem left: 4.84687872E8, server swap mem left:4.455759872E9.Etc message: start latency: 2@1,agg done@12,compress done@12,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:42:52,077 DEBUG [pool-8-thread-5] util.CompressionUtils:67 : Original: 357 bytes. Decompressed: 819 bytes. Time: 0 2016-08-15 03:42:52,080 INFO [pool-8-thread-6] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 39. Total filtered/aggred row: 0. Time elapsed in EP: 15(ms). Server CPU usage: 0.5, server physical mem left: 4.84687872E8, server swap mem left:4.455759872E9.Etc message: start latency: 3@2,agg done@15,compress done@15,server stats done@15, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:42:52,081 DEBUG [pool-8-thread-6] util.CompressionUtils:67 : Original: 357 bytes. Decompressed: 819 bytes. Time: 0 2016-08-15 03:42:52,096 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 39, 2016-08-15 03:42:52,097 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 192, total scan count 39 2016-08-15 03:42:52,098 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table where device = 'Other' order by minute_start desc User: ADMIN Success: true Duration: 0.192 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 39 Result row count: 39 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:43:36,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:44:36,105 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:45:36,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:46:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:47:36,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:48:36,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:49:36,008 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:50:24,610 INFO [http-bio-7070-exec-6] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:50:24,613 INFO [http-bio-7070-exec-6] controller.QueryController:175 : The original query: select * from streaming_sales_table where device != '' order by minute_start desc 2016-08-15 03:50:24,614 INFO [http-bio-7070-exec-6] service.QueryService:266 : The corrected query: select * from streaming_sales_table where device != '' order by minute_start desc LIMIT 50000 2016-08-15 03:50:24,633 ERROR [http-bio-7070-exec-6] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select * from streaming_sales_table where device != '' order by minute_start desc LIMIT 50000": parse failed: Lexical error at line 3, column 14. Encountered: "!" (33), after : "" at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: parse failed: Lexical error at line 3, column 14. Encountered: "!" (33), after : "" at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:694) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 80 more Caused by: org.apache.calcite.sql.parser.SqlParseException: Lexical error at line 3, column 14. Encountered: "!" (33), after : "" at org.apache.calcite.sql.parser.impl.SqlParserImpl.convertException(SqlParserImpl.java:389) at org.apache.calcite.sql.parser.impl.SqlParserImpl.normalizeException(SqlParserImpl.java:119) at org.apache.calcite.sql.parser.SqlParser.parseQuery(SqlParser.java:131) at org.apache.calcite.sql.parser.SqlParser.parseStmt(SqlParser.java:156) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:691) ... 86 more Caused by: org.apache.calcite.sql.parser.impl.TokenMgrError: Lexical error at line 3, column 14. Encountered: "!" (33), after : "" at org.apache.calcite.sql.parser.impl.SqlParserImplTokenManager.getNextToken(SqlParserImplTokenManager.java:13860) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_scan_token(SqlParserImpl.java:16768) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3_306(SqlParserImpl.java:15673) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3R_49(SqlParserImpl.java:15694) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3_386(SqlParserImpl.java:12123) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3R_79(SqlParserImpl.java:12143) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3R_126(SqlParserImpl.java:12421) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3R_116(SqlParserImpl.java:11876) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3R_70(SqlParserImpl.java:12091) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_3_197(SqlParserImpl.java:12363) at org.apache.calcite.sql.parser.impl.SqlParserImpl.jj_2_197(SqlParserImpl.java:6692) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression3(SqlParserImpl.java:2628) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression2(SqlParserImpl.java:2461) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression(SqlParserImpl.java:2433) at org.apache.calcite.sql.parser.impl.SqlParserImpl.WhereOpt(SqlParserImpl.java:1934) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlSelect(SqlParserImpl.java:878) at org.apache.calcite.sql.parser.impl.SqlParserImpl.LeafQuery(SqlParserImpl.java:579) at org.apache.calcite.sql.parser.impl.SqlParserImpl.LeafQueryOrExpr(SqlParserImpl.java:2418) at org.apache.calcite.sql.parser.impl.SqlParserImpl.QueryOrExpr(SqlParserImpl.java:2337) at org.apache.calcite.sql.parser.impl.SqlParserImpl.OrderedQueryOrExpr(SqlParserImpl.java:497) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlStmt(SqlParserImpl.java:806) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlStmtEof(SqlParserImpl.java:832) at org.apache.calcite.sql.parser.impl.SqlParserImpl.parseSqlStmtEof(SqlParserImpl.java:178) at org.apache.calcite.sql.parser.SqlParser.parseQuery(SqlParser.java:124) ... 88 more 2016-08-15 03:50:24,637 INFO [http-bio-7070-exec-6] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table where device != '' order by minute_start desc User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Lexical error at line 3, column 14. Encountered: "!" (33), after : "" ==========================[QUERY]=============================== 2016-08-15 03:50:24,637 ERROR [http-bio-7070-exec-6] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Lexical error at line 3, column 14. Encountered: "!" (33), after : "" at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:50:33,474 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:50:33,480 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select * from streaming_sales_table where device <> '' order by minute_start desc 2016-08-15 03:50:33,483 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select * from streaming_sales_table where device <> '' order by minute_start desc LIMIT 50000 2016-08-15 03:50:33,599 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:50:33,599 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@62979cdf 2016-08-15 03:50:33,600 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:50:33,600 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:50:33,601 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:50:33,654 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:50:33,654 INFO [http-bio-7070-exec-2] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:50:33,655 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:50:33,656 ERROR [http-bio-7070-exec-2] dict.TrieDictionary:173 : Not a valid value: 2016-08-15 03:50:33,658 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:50:33,659 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1141 bytes, rawScanBytesString 68 bytes 2016-08-15 03:50:33,659 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 7d658a4f for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:50:33,661 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:50:33,661 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:50:33,739 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:50:33,740 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:50:33,768 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 25(ms). Server CPU usage: 0.0, server physical mem left: 1.22753024E8, server swap mem left:4.348411904E9.Etc message: start latency: 1@12,agg done@24,compress done@24,server stats done@25, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:50:33,768 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 24(ms). Server CPU usage: 0.07168576104746317, server physical mem left: 1.22753024E8, server swap mem left:4.348411904E9.Etc message: start latency: 1@12,agg done@23,compress done@23,server stats done@24, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:50:33,768 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 0 2016-08-15 03:50:33,768 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 0 2016-08-15 03:50:33,816 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:50:33,817 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 336, total scan count 138 2016-08-15 03:50:33,817 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table where device <> '' order by minute_start desc User: ADMIN Success: true Duration: 0.336 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:50:36,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:50:48,138 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:50:48,139 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select * from streaming_sales_table where device = '' order by minute_start desc 2016-08-15 03:50:48,140 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select * from streaming_sales_table where device = '' order by minute_start desc LIMIT 50000 2016-08-15 03:50:48,220 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:50:48,220 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@389d4e7f 2016-08-15 03:50:48,220 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:50:48,220 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:50:48,221 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:50:48,269 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:50:48,270 INFO [http-bio-7070-exec-10] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:50:48,272 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:50:48,272 ERROR [http-bio-7070-exec-10] dict.TrieDictionary:173 : Not a valid value: 2016-08-15 03:50:48,274 INFO [http-bio-7070-exec-10] gridtable.ScannerWorker:41 : Segment Streaming_Cube[20160815032000_20160815032500] will be skipped 2016-08-15 03:50:48,424 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:50:48,426 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 0, 2016-08-15 03:50:48,427 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 287, total scan count 0 2016-08-15 03:50:48,427 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table where device = '' order by minute_start desc User: ADMIN Success: true Duration: 0.287 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:50:57,662 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:50:57,663 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select * from streaming_sales_table order by minute_start desc 2016-08-15 03:50:57,664 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select * from streaming_sales_table order by minute_start desc LIMIT 50000 2016-08-15 03:50:57,744 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:50:57,744 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@663e6142 2016-08-15 03:50:57,745 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:50:57,745 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:50:57,745 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:50:57,771 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:50:57,771 INFO [http-bio-7070-exec-10] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:50:57,772 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:50:57,774 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:50:57,776 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1137 bytes, rawScanBytesString 68 bytes 2016-08-15 03:50:57,776 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 65b15a2e for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:50:57,778 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:50:57,778 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:50:57,779 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:50:57,779 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:50:57,796 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 13(ms). Server CPU usage: 0.03110684989879621, server physical mem left: 1.41037568E8, server swap mem left:4.327489536E9.Etc message: start latency: 1@1,agg done@12,compress done@12,server stats done@13, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:50:57,796 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 13(ms). Server CPU usage: 0.0, server physical mem left: 1.41037568E8, server swap mem left:4.327489536E9.Etc message: start latency: 1@1,agg done@13,compress done@13,server stats done@13, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:50:57,796 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 0 2016-08-15 03:50:57,797 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 1 2016-08-15 03:50:57,832 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:50:57,832 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 169, total scan count 138 2016-08-15 03:50:57,832 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table order by minute_start desc User: ADMIN Success: true Duration: 0.169 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:51:11,094 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:51:11,095 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 03:51:11,096 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 03:51:11,155 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:51:11,156 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@71807bc2 2016-08-15 03:51:11,156 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:51:11,157 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:51:11,157 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:51:11,214 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:51:11,214 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:51:11,216 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:51:11,217 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 266 bytes, rawScanBytesString 46 bytes 2016-08-15 03:51:11,217 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 56a7d8a for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:51:11,218 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:51:11,218 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:51:11,284 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:51:11,286 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:51:11,292 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.13710907704042716, server physical mem left: 1.35532544E8, server swap mem left:4.32769024E9.Etc message: start latency: 3@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:51:11,293 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 26 bytes. Decompressed: 25 bytes. Time: 0 2016-08-15 03:51:11,293 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 1.35532544E8, server swap mem left:4.32769024E9.Etc message: start latency: 3@0,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:51:11,294 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 26 bytes. Decompressed: 25 bytes. Time: 0 2016-08-15 03:51:11,297 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 03:51:11,298 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 202, total scan count 5 2016-08-15 03:51:11,298 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.202 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:51:23,435 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:51:23,436 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select minute_start from streaming_sales_table order by minute_start desc 2016-08-15 03:51:23,436 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select minute_start from streaming_sales_table order by minute_start desc LIMIT 50000 2016-08-15 03:51:23,507 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:51:23,507 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@3536c0ed 2016-08-15 03:51:23,508 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:51:23,508 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:51:23,509 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:51:23,552 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:51:23,552 INFO [http-bio-7070-exec-9] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:51:23,553 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:51:23,554 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:51:23,555 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1126 bytes, rawScanBytesString 63 bytes 2016-08-15 03:51:23,555 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 2eaabaf9 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:51:23,557 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:51:23,557 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:51:23,557 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:51:23,557 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:51:23,570 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 0.023458584181025536, server physical mem left: 1.37531392E8, server swap mem left:4.327923712E9.Etc message: start latency: 1@1,agg done@6,compress done@7,server stats done@9, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:51:23,570 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 0.0, server physical mem left: 1.37531392E8, server swap mem left:4.327923712E9.Etc message: start latency: 1@1,agg done@7,compress done@9,server stats done@9, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:51:23,571 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 453 bytes. Decompressed: 2070 bytes. Time: 1 2016-08-15 03:51:23,571 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 453 bytes. Decompressed: 2070 bytes. Time: 0 2016-08-15 03:51:23,601 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:51:23,601 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 165, total scan count 138 2016-08-15 03:51:23,602 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start from streaming_sales_table order by minute_start desc User: ADMIN Success: true Duration: 0.165 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:51:36,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:51:39,449 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:51:39,451 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select count(*) from streaming_sales_table 2016-08-15 03:51:39,452 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select count(*) from streaming_sales_table LIMIT 50000 2016-08-15 03:51:39,533 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:51:39,534 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@32826d5 2016-08-15 03:51:39,535 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:51:39,535 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:51:39,536 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:51:39,650 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:51:39,652 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:222 : exactAggregation is false because cuboid 0=> 4 2016-08-15 03:51:39,653 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:51:39,654 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 03:51:39,654 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 61b802d0 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:51:39,655 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid require post aggregation, from 0 to 4 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xFF\x00), No Fuzzy Key 2016-08-15 03:51:39,656 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:51:39,656 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:51:39,657 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:51:39,681 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 14(ms). Server CPU usage: 0.037031150667514307, server physical mem left: 1.36531968E8, server swap mem left:4.328185856E9.Etc message: start latency: 2@1,agg done@13,compress done@13,server stats done@14, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:51:39,681 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 14(ms). Server CPU usage: 1.0, server physical mem left: 1.36531968E8, server swap mem left:4.328185856E9.Etc message: start latency: 7@1,agg done@13,compress done@14,server stats done@14, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:51:39,681 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 03:51:39,682 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 03:51:39,684 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 1, 2016-08-15 03:51:39,684 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 232, total scan count 1 2016-08-15 03:51:39,685 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select count(*) from streaming_sales_table User: ADMIN Success: true Duration: 0.232 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [4] Total scan count: 1 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:51:46,704 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:51:46,704 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select count(*) from streaming_sales_table order by minute_start desc 2016-08-15 03:51:46,704 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select count(*) from streaming_sales_table order by minute_start desc LIMIT 50000 2016-08-15 03:51:46,739 ERROR [http-bio-7070-exec-9] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select count(*) from streaming_sales_table order by minute_start desc LIMIT 50000": From line 3, column 10 to line 3, column 21: Expression 'STREAMING_SALES_TABLE.MINUTE_START' is not being grouped at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 3, column 10 to line 3, column 21: Expression 'STREAMING_SALES_TABLE.MINUTE_START' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:110) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:39) at org.apache.calcite.sql.SqlIdentifier.accept(SqlIdentifier.java:307) at org.apache.calcite.sql.validate.AggregatingSelectScope.checkAggregateExpr(AggregatingSelectScope.java:231) at org.apache.calcite.sql.validate.AggregatingSelectScope.validateExpr(AggregatingSelectScope.java:240) at org.apache.calcite.sql.validate.OrderByScope.validateExpr(OrderByScope.java:98) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateExpr(SqlValidatorImpl.java:3495) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateOrderItem(SqlValidatorImpl.java:3277) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateOrderItem(SqlValidatorImpl.java:3271) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateOrderList(SqlValidatorImpl.java:3261) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2976) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 80 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Expression 'STREAMING_SALES_TABLE.MINUTE_START' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 111 more 2016-08-15 03:51:46,741 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select count(*) from streaming_sales_table order by minute_start desc User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [4] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select count(*) from streaming_sales_table order by minute_start desc LIMIT 50000": From line 3, column 10 to line 3, column 21: Expression 'STREAMING_SALES_TABLE.MINUTE_START' is not being grouped ==========================[QUERY]=============================== 2016-08-15 03:51:46,741 ERROR [http-bio-7070-exec-9] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select count(*) from streaming_sales_table order by minute_start desc LIMIT 50000": From line 3, column 10 to line 3, column 21: Expression 'STREAMING_SALES_TABLE.MINUTE_START' is not being grouped at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:52:09,747 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:52:09,748 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table order by minute_start desc 2016-08-15 03:52:09,748 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table order by minute_start desc LIMIT 50000 2016-08-15 03:52:09,807 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:52:09,808 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@593dd5ca 2016-08-15 03:52:09,808 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:52:09,809 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:52:09,809 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:52:09,842 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:52:09,842 INFO [http-bio-7070-exec-5] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:52:09,843 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:52:09,844 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:52:09,846 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1133 bytes, rawScanBytesString 68 bytes 2016-08-15 03:52:09,846 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 3ddc5516 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:52:09,847 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:52:09,847 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:52:09,848 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:52:09,848 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:52:09,862 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 10(ms). Server CPU usage: 0.061396841482982856, server physical mem left: 1.24780544E8, server swap mem left:4.32887808E9.Etc message: start latency: 2@0,agg done@9,compress done@10,server stats done@10, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:52:09,863 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 638 bytes. Decompressed: 2208 bytes. Time: 0 2016-08-15 03:52:09,872 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 19(ms). Server CPU usage: 0.5, server physical mem left: 1.24780544E8, server swap mem left:4.32887808E9.Etc message: start latency: 2@0,agg done@18,compress done@18,server stats done@19, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:52:09,873 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 638 bytes. Decompressed: 2208 bytes. Time: 0 2016-08-15 03:52:09,890 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:52:09,890 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 142, total scan count 138 2016-08-15 03:52:09,891 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table order by minute_start desc User: ADMIN Success: true Duration: 0.142 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:52:36,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:52:38,193 INFO [http-bio-7070-exec-6] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:52:38,194 INFO [http-bio-7070-exec-6] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table --order by minute_start desc 2016-08-15 03:52:38,195 INFO [http-bio-7070-exec-6] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table --order by minute_start desc LIMIT 50000 2016-08-15 03:52:38,245 INFO [http-bio-7070-exec-6] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:52:38,247 INFO [http-bio-7070-exec-6] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@83ca1d3 2016-08-15 03:52:38,248 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:52:38,248 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:52:38,249 INFO [http-bio-7070-exec-6] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:52:38,272 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:52:38,273 INFO [http-bio-7070-exec-6] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:52:38,274 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:52:38,274 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 03:52:38,276 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:52:38,278 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1133 bytes, rawScanBytesString 68 bytes 2016-08-15 03:52:38,278 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:315 : The scan 66f5f2c4 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:52:38,281 INFO [http-bio-7070-exec-6] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:52:38,282 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:52:38,347 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:52:38,348 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:52:38,365 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 11(ms). Server CPU usage: 0.0281664872622892, server physical mem left: 1.46313216E8, server swap mem left:4.30336E9.Etc message: start latency: 1@1,agg done@10,compress done@10,server stats done@11, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:52:38,365 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 638 bytes. Decompressed: 2208 bytes. Time: 0 2016-08-15 03:52:38,369 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 17(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.46313216E8, server swap mem left:4.30336E9.Etc message: start latency: 3@1,agg done@16,compress done@16,server stats done@17, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:52:38,370 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 638 bytes. Decompressed: 2208 bytes. Time: 0 2016-08-15 03:52:38,400 INFO [http-bio-7070-exec-6] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:52:38,402 INFO [http-bio-7070-exec-6] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 207, total scan count 138 2016-08-15 03:52:38,402 INFO [http-bio-7070-exec-6] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table --order by minute_start desc User: ADMIN Success: true Duration: 0.207 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:52:48,952 INFO [http-bio-7070-exec-6] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:52:48,952 INFO [http-bio-7070-exec-6] controller.QueryController:175 : The original query: select * from streaming_sales_table 2016-08-15 03:52:48,953 INFO [http-bio-7070-exec-6] service.QueryService:266 : The corrected query: select * from streaming_sales_table LIMIT 50000 2016-08-15 03:52:48,992 INFO [http-bio-7070-exec-6] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:52:48,992 INFO [http-bio-7070-exec-6] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@5c1f9473 2016-08-15 03:52:48,993 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:52:48,993 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:52:48,994 INFO [http-bio-7070-exec-6] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:52:49,003 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:52:49,003 INFO [http-bio-7070-exec-6] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:52:49,004 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:52:49,005 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 03:52:49,006 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:52:49,007 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1137 bytes, rawScanBytesString 68 bytes 2016-08-15 03:52:49,008 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:315 : The scan 3ad4f0be for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:52:49,011 INFO [http-bio-7070-exec-6] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:52:49,012 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:52:49,012 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:52:49,012 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:52:49,027 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 10(ms). Server CPU usage: 0.02853717026378897, server physical mem left: 1.35581696E8, server swap mem left:4.309929984E9.Etc message: start latency: 2@1,agg done@9,compress done@9,server stats done@10, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:52:49,028 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 0 2016-08-15 03:52:49,037 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 17(ms). Server CPU usage: 0.5, server physical mem left: 1.35581696E8, server swap mem left:4.309929984E9.Etc message: start latency: 2@1,agg done@17,compress done@17,server stats done@17, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:52:49,038 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 1 2016-08-15 03:52:49,053 INFO [http-bio-7070-exec-6] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:52:49,054 INFO [http-bio-7070-exec-6] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 102, total scan count 138 2016-08-15 03:52:49,054 INFO [http-bio-7070-exec-6] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table User: ADMIN Success: true Duration: 0.102 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:53:01,843 INFO [http-bio-7070-exec-6] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:53:01,843 INFO [http-bio-7070-exec-6] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table 2016-08-15 03:53:01,843 INFO [http-bio-7070-exec-6] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table LIMIT 50000 2016-08-15 03:53:01,887 INFO [http-bio-7070-exec-6] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:53:01,888 INFO [http-bio-7070-exec-6] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@4911ff7d 2016-08-15 03:53:01,888 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:53:01,888 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:53:01,889 INFO [http-bio-7070-exec-6] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:53:01,914 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:53:01,914 INFO [http-bio-7070-exec-6] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:53:01,915 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:53:01,915 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 03:53:01,916 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:53:01,918 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1133 bytes, rawScanBytesString 68 bytes 2016-08-15 03:53:01,918 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:315 : The scan 3ffad3cf for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:53:01,919 INFO [http-bio-7070-exec-6] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 03:53:01,920 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:53:01,920 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:53:01,921 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:53:01,951 INFO [pool-8-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 18(ms). Server CPU usage: 0.11170528817587641, server physical mem left: 1.34807552E8, server swap mem left:4.310269952E9.Etc message: start latency: 2@1,agg done@12,compress done@12,server stats done@18, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:53:01,952 DEBUG [pool-8-thread-8] util.CompressionUtils:67 : Original: 638 bytes. Decompressed: 2208 bytes. Time: 0 2016-08-15 03:53:01,952 INFO [pool-8-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 18(ms). Server CPU usage: 0.0, server physical mem left: 1.34807552E8, server swap mem left:4.310269952E9.Etc message: start latency: 11@1,agg done@12,compress done@12,server stats done@18, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:53:01,952 DEBUG [pool-8-thread-7] util.CompressionUtils:67 : Original: 638 bytes. Decompressed: 2208 bytes. Time: 0 2016-08-15 03:53:01,972 INFO [http-bio-7070-exec-6] service.QueryService:399 : Scan count for each storageContext: 138, 2016-08-15 03:53:01,976 INFO [http-bio-7070-exec-6] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 133, total scan count 138 2016-08-15 03:53:01,976 INFO [http-bio-7070-exec-6] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table User: ADMIN Success: true Duration: 0.133 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 138 Result row count: 138 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:53:36,016 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:53:59,513 INFO [http-bio-7070-exec-1] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:53:59,519 INFO [http-bio-7070-exec-1] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' 2016-08-15 03:53:59,519 INFO [http-bio-7070-exec-1] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' LIMIT 50000 2016-08-15 03:53:59,537 ERROR [http-bio-7070-exec-1] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' LIMIT 50000": parse failed: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: parse failed: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:694) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.parser.SqlParseException: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.calcite.sql.parser.impl.SqlParserImpl.convertException(SqlParserImpl.java:389) at org.apache.calcite.sql.parser.impl.SqlParserImpl.normalizeException(SqlParserImpl.java:119) at org.apache.calcite.sql.parser.SqlParser.parseQuery(SqlParser.java:131) at org.apache.calcite.sql.parser.SqlParser.parseStmt(SqlParser.java:156) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:691) ... 85 more Caused by: org.apache.calcite.runtime.CalciteException: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.parser.impl.SqlParserImpl.parseDateLiteral(SqlParserImpl.java:293) at org.apache.calcite.sql.parser.impl.SqlParserImpl.DateTimeLiteral(SqlParserImpl.java:3192) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Literal(SqlParserImpl.java:2961) at org.apache.calcite.sql.parser.impl.SqlParserImpl.AtomicRowExpression(SqlParserImpl.java:2761) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression3(SqlParserImpl.java:2629) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression2(SqlParserImpl.java:2583) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression(SqlParserImpl.java:2433) at org.apache.calcite.sql.parser.impl.SqlParserImpl.WhereOpt(SqlParserImpl.java:1934) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlSelect(SqlParserImpl.java:878) at org.apache.calcite.sql.parser.impl.SqlParserImpl.LeafQuery(SqlParserImpl.java:579) at org.apache.calcite.sql.parser.impl.SqlParserImpl.LeafQueryOrExpr(SqlParserImpl.java:2418) at org.apache.calcite.sql.parser.impl.SqlParserImpl.QueryOrExpr(SqlParserImpl.java:2337) at org.apache.calcite.sql.parser.impl.SqlParserImpl.OrderedQueryOrExpr(SqlParserImpl.java:497) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlStmt(SqlParserImpl.java:806) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlStmtEof(SqlParserImpl.java:832) at org.apache.calcite.sql.parser.impl.SqlParserImpl.parseSqlStmtEof(SqlParserImpl.java:178) at org.apache.calcite.sql.parser.SqlParser.parseQuery(SqlParser.java:124) ... 87 more 2016-08-15 03:53:59,540 INFO [http-bio-7070-exec-1] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' ==========================[QUERY]=============================== 2016-08-15 03:53:59,541 ERROR [http-bio-7070-exec-1] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:54:06,643 INFO [http-bio-7070-exec-7] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:54:06,644 INFO [http-bio-7070-exec-7] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table where minute_start = '2016-08-15 03:20:00' 2016-08-15 03:54:06,645 INFO [http-bio-7070-exec-7] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table where minute_start = '2016-08-15 03:20:00' LIMIT 50000 2016-08-15 03:54:06,717 INFO [http-bio-7070-exec-7] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:54:06,717 INFO [http-bio-7070-exec-7] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@473003e5 2016-08-15 03:54:06,718 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:54:06,718 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:54:06,718 INFO [http-bio-7070-exec-7] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:54:06,732 ERROR [http-bio-7070-exec-7] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, category, qty from streaming_sales_table where minute_start = '2016-08-15 03:20:00' LIMIT 50000": Error while compiling generated Java code: org.apache.calcite.DataContext root; public org.apache.calcite.linq4j.Enumerable bind(final org.apache.calcite.DataContext root0) { root = root0; final org.apache.calcite.linq4j.Enumerable _inputEnumerable = ((org.apache.kylin.query.schema.OLAPTable) root.getRootSchema().getSubSchema("DEFAULT").getTable("STREAMING_SALES_TABLE")).executeOLAPQuery(root, 0); final org.apache.calcite.linq4j.AbstractEnumerable child = new org.apache.calcite.linq4j.AbstractEnumerable(){ public org.apache.calcite.linq4j.Enumerator enumerator() { return new org.apache.calcite.linq4j.Enumerator(){ public final org.apache.calcite.linq4j.Enumerator inputEnumerator = _inputEnumerable.enumerator(); public void reset() { inputEnumerator.reset(); } public boolean moveNext() { while (inputEnumerator.moveNext()) { final Long inp3_ = (Long) ((Object[]) inputEnumerator.current())[3]; if (inp3_ != null && inp3_ == "2016-08-15 03:20:00") { return true; } } return false; } public void close() { inputEnumerator.close(); } public Object current() { final Object[] current = (Object[]) inputEnumerator.current(); return new Object[] { current[3], current[0], current[8]}; } }; } }; return child.take(50000); } public Class getElementType() { return java.lang.Object[].class; } at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: Error while compiling generated Java code: org.apache.calcite.DataContext root; public org.apache.calcite.linq4j.Enumerable bind(final org.apache.calcite.DataContext root0) { root = root0; final org.apache.calcite.linq4j.Enumerable _inputEnumerable = ((org.apache.kylin.query.schema.OLAPTable) root.getRootSchema().getSubSchema("DEFAULT").getTable("STREAMING_SALES_TABLE")).executeOLAPQuery(root, 0); final org.apache.calcite.linq4j.AbstractEnumerable child = new org.apache.calcite.linq4j.AbstractEnumerable(){ public org.apache.calcite.linq4j.Enumerator enumerator() { return new org.apache.calcite.linq4j.Enumerator(){ public final org.apache.calcite.linq4j.Enumerator inputEnumerator = _inputEnumerable.enumerator(); public void reset() { inputEnumerator.reset(); } public boolean moveNext() { while (inputEnumerator.moveNext()) { final Long inp3_ = (Long) ((Object[]) inputEnumerator.current())[3]; if (inp3_ != null && inp3_ == "2016-08-15 03:20:00") { return true; } } return false; } public void close() { inputEnumerator.close(); } public Object current() { final Object[] current = (Object[]) inputEnumerator.current(); return new Object[] { current[3], current[0], current[8]}; } }; } }; return child.take(50000); } public Class getElementType() { return java.lang.Object[].class; } at org.apache.calcite.avatica.Helper.wrap(Helper.java:37) at org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:108) at org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1171) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:297) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.codehaus.commons.compiler.CompileException: Line 17, Column 44: Incomparable types 'java.lang.Long' and 'java.lang.String' at org.codehaus.janino.UnitCompiler.compileError(UnitCompiler.java:10092) at org.codehaus.janino.UnitCompiler.compileBoolean2(UnitCompiler.java:3080) at org.codehaus.janino.UnitCompiler.access$5000(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$8.visitBinaryOperation(UnitCompiler.java:2797) at org.codehaus.janino.Java$BinaryOperation.accept(Java.java:3768) at org.codehaus.janino.UnitCompiler.compileBoolean(UnitCompiler.java:2830) at org.codehaus.janino.UnitCompiler.compileBoolean2(UnitCompiler.java:2924) at org.codehaus.janino.UnitCompiler.access$5000(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$8.visitBinaryOperation(UnitCompiler.java:2797) at org.codehaus.janino.Java$BinaryOperation.accept(Java.java:3768) at org.codehaus.janino.UnitCompiler.compileBoolean(UnitCompiler.java:2830) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:1742) at org.codehaus.janino.UnitCompiler.access$1200(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$4.visitIfStatement(UnitCompiler.java:935) at org.codehaus.janino.Java$IfStatement.accept(Java.java:2157) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:956) at org.codehaus.janino.UnitCompiler.compileStatements(UnitCompiler.java:997) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:983) at org.codehaus.janino.UnitCompiler.access$1000(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$4.visitBlock(UnitCompiler.java:933) at org.codehaus.janino.Java$Block.accept(Java.java:2012) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:956) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:1263) at org.codehaus.janino.UnitCompiler.access$1500(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$4.visitWhileStatement(UnitCompiler.java:938) at org.codehaus.janino.Java$WhileStatement.accept(Java.java:2244) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:956) at org.codehaus.janino.UnitCompiler.compileStatements(UnitCompiler.java:997) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:2283) at org.codehaus.janino.UnitCompiler.compileDeclaredMethods(UnitCompiler.java:820) at org.codehaus.janino.UnitCompiler.compileDeclaredMethods(UnitCompiler.java:792) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:505) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:656) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:620) at org.codehaus.janino.UnitCompiler.access$200(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$2.visitAnonymousClassDeclaration(UnitCompiler.java:343) at org.codehaus.janino.Java$AnonymousClassDeclaration.accept(Java.java:894) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:352) at org.codehaus.janino.UnitCompiler.compileGet2(UnitCompiler.java:4194) at org.codehaus.janino.UnitCompiler.access$7300(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$10.visitNewAnonymousClassInstance(UnitCompiler.java:3260) at org.codehaus.janino.Java$NewAnonymousClassInstance.accept(Java.java:4131) at org.codehaus.janino.UnitCompiler.compileGet(UnitCompiler.java:3278) at org.codehaus.janino.UnitCompiler.compileGetValue(UnitCompiler.java:4345) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:1901) at org.codehaus.janino.UnitCompiler.access$2100(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$4.visitReturnStatement(UnitCompiler.java:944) at org.codehaus.janino.Java$ReturnStatement.accept(Java.java:2544) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:956) at org.codehaus.janino.UnitCompiler.compileStatements(UnitCompiler.java:997) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:2283) at org.codehaus.janino.UnitCompiler.compileDeclaredMethods(UnitCompiler.java:820) at org.codehaus.janino.UnitCompiler.compileDeclaredMethods(UnitCompiler.java:792) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:505) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:656) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:620) at org.codehaus.janino.UnitCompiler.access$200(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$2.visitAnonymousClassDeclaration(UnitCompiler.java:343) at org.codehaus.janino.Java$AnonymousClassDeclaration.accept(Java.java:894) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:352) at org.codehaus.janino.UnitCompiler.compileGet2(UnitCompiler.java:4194) at org.codehaus.janino.UnitCompiler.access$7300(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$10.visitNewAnonymousClassInstance(UnitCompiler.java:3260) at org.codehaus.janino.Java$NewAnonymousClassInstance.accept(Java.java:4131) at org.codehaus.janino.UnitCompiler.compileGet(UnitCompiler.java:3278) at org.codehaus.janino.UnitCompiler.compileGetValue(UnitCompiler.java:4345) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:1835) at org.codehaus.janino.UnitCompiler.access$2000(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$4.visitLocalVariableDeclarationStatement(UnitCompiler.java:943) at org.codehaus.janino.Java$LocalVariableDeclarationStatement.accept(Java.java:2508) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:956) at org.codehaus.janino.UnitCompiler.compileStatements(UnitCompiler.java:997) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:2283) at org.codehaus.janino.UnitCompiler.compileDeclaredMethods(UnitCompiler.java:820) at org.codehaus.janino.UnitCompiler.compileDeclaredMethods(UnitCompiler.java:792) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:505) at org.codehaus.janino.UnitCompiler.compile2(UnitCompiler.java:391) at org.codehaus.janino.UnitCompiler.access$400(UnitCompiler.java:183) at org.codehaus.janino.UnitCompiler$2.visitPackageMemberClassDeclaration(UnitCompiler.java:345) at org.codehaus.janino.Java$PackageMemberClassDeclaration.accept(Java.java:1139) at org.codehaus.janino.UnitCompiler.compile(UnitCompiler.java:352) at org.codehaus.janino.UnitCompiler.compileUnit(UnitCompiler.java:320) at org.codehaus.janino.SimpleCompiler.compileToClassLoader(SimpleCompiler.java:383) at org.codehaus.janino.ClassBodyEvaluator.compileToClass(ClassBodyEvaluator.java:315) at org.codehaus.janino.ClassBodyEvaluator.cook(ClassBodyEvaluator.java:233) at org.codehaus.janino.SimpleCompiler.cook(SimpleCompiler.java:192) at org.codehaus.commons.compiler.Cookable.cook(Cookable.java:47) at org.codehaus.janino.ClassBodyEvaluator.createInstance(ClassBodyEvaluator.java:340) at org.apache.calcite.adapter.enumerable.EnumerableInterpretable.getBindable(EnumerableInterpretable.java:140) at org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:105) ... 89 more 2016-08-15 03:54:06,736 INFO [http-bio-7070-exec-7] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table where minute_start = '2016-08-15 03:20:00' User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select minute_start, category, qty from streaming_sales_table where minute_start = '2016-08-15 03:20:00' LIMIT 50000": Error while compiling generated Java code: org.apache.calcite.DataContext root; public org.apache.calcite.linq4j.Enumerable bind(final org.apache.calcite.DataContext root0) { root = root0; final org.apache.calcite.linq4j.Enumerable _inputEnumerable = ((org.apache.kylin.query.schema.OLAPTable) root.getRootSchema().getSubSchema("DEFAULT").getTable("STREAMING_SALES_TABLE")).executeOLAPQuery(root, 0); final org.apache.calcite.linq4j.AbstractEnumerable child = new org.apache.calcite.linq4j.AbstractEnumerable(){ public org.apache.calcite.linq4j.Enumerator enumerator() { return new org.apache.calcite.linq4j.Enumerator(){ public final org.apache.calcite.linq4j.Enumerator inputEnumerator = _inputEnumerable.enumerator(); public void reset() { inputEnumerator.reset(); } public boolean moveNext() { while (inputEnumerator.moveNext()) { final Long inp3_ = (Long) ((Object[]) inputEnumerator.current())[3]; if (inp3_ != null && inp3_ == "2016-08-15 03:20:00") { return true; } } return false; } public void close() { inputEnumerator.close(); } public Object current() { final Object[] current = (Object[]) inputEnumerator.current(); return new Object[] { current[3], current[0], current[8]}; } }; } }; return child.take(50000); } public Class getElementType() { return java.lang.Object[].class; } ==========================[QUERY]=============================== 2016-08-15 03:54:06,737 ERROR [http-bio-7070-exec-7] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select minute_start, category, qty from streaming_sales_table where minute_start = '2016-08-15 03:20:00' LIMIT 50000": Error while compiling generated Java code: org.apache.calcite.DataContext root; public org.apache.calcite.linq4j.Enumerable bind(final org.apache.calcite.DataContext root0) { root = root0; final org.apache.calcite.linq4j.Enumerable _inputEnumerable = ((org.apache.kylin.query.schema.OLAPTable) root.getRootSchema().getSubSchema("DEFAULT").getTable("STREAMING_SALES_TABLE")).executeOLAPQuery(root, 0); final org.apache.calcite.linq4j.AbstractEnumerable child = new org.apache.calcite.linq4j.AbstractEnumerable(){ public org.apache.calcite.linq4j.Enumerator enumerator() { return new org.apache.calcite.linq4j.Enumerator(){ public final org.apache.calcite.linq4j.Enumerator inputEnumerator = _inputEnumerable.enumerator(); public void reset() { inputEnumerator.reset(); } public boolean moveNext() { while (inputEnumerator.moveNext()) { final Long inp3_ = (Long) ((Object[]) inputEnumerator.current())[3]; if (inp3_ != null && inp3_ == "2016-08-15 03:20:00") { return true; } } return false; } public void close() { inputEnumerator.close(); } public Object current() { final Object[] current = (Object[]) inputEnumerator.current(); return new Object[] { current[3], current[0], current[8]}; } }; } }; return child.take(50000); } public Class getElementType() { return java.lang.Object[].class; } at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:54:17,041 INFO [http-bio-7070-exec-8] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:54:17,042 INFO [http-bio-7070-exec-8] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' 2016-08-15 03:54:17,043 INFO [http-bio-7070-exec-8] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' LIMIT 50000 2016-08-15 03:54:17,064 ERROR [http-bio-7070-exec-8] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' LIMIT 50000": parse failed: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: parse failed: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:694) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.parser.SqlParseException: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.calcite.sql.parser.impl.SqlParserImpl.convertException(SqlParserImpl.java:389) at org.apache.calcite.sql.parser.impl.SqlParserImpl.normalizeException(SqlParserImpl.java:119) at org.apache.calcite.sql.parser.SqlParser.parseQuery(SqlParser.java:131) at org.apache.calcite.sql.parser.SqlParser.parseStmt(SqlParser.java:156) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:691) ... 85 more Caused by: org.apache.calcite.runtime.CalciteException: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.parser.impl.SqlParserImpl.parseDateLiteral(SqlParserImpl.java:293) at org.apache.calcite.sql.parser.impl.SqlParserImpl.DateTimeLiteral(SqlParserImpl.java:3192) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Literal(SqlParserImpl.java:2961) at org.apache.calcite.sql.parser.impl.SqlParserImpl.AtomicRowExpression(SqlParserImpl.java:2761) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression3(SqlParserImpl.java:2629) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression2(SqlParserImpl.java:2583) at org.apache.calcite.sql.parser.impl.SqlParserImpl.Expression(SqlParserImpl.java:2433) at org.apache.calcite.sql.parser.impl.SqlParserImpl.WhereOpt(SqlParserImpl.java:1934) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlSelect(SqlParserImpl.java:878) at org.apache.calcite.sql.parser.impl.SqlParserImpl.LeafQuery(SqlParserImpl.java:579) at org.apache.calcite.sql.parser.impl.SqlParserImpl.LeafQueryOrExpr(SqlParserImpl.java:2418) at org.apache.calcite.sql.parser.impl.SqlParserImpl.QueryOrExpr(SqlParserImpl.java:2337) at org.apache.calcite.sql.parser.impl.SqlParserImpl.OrderedQueryOrExpr(SqlParserImpl.java:497) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlStmt(SqlParserImpl.java:806) at org.apache.calcite.sql.parser.impl.SqlParserImpl.SqlStmtEof(SqlParserImpl.java:832) at org.apache.calcite.sql.parser.impl.SqlParserImpl.parseSqlStmtEof(SqlParserImpl.java:178) at org.apache.calcite.sql.parser.SqlParser.parseQuery(SqlParser.java:124) ... 87 more 2016-08-15 03:54:17,067 INFO [http-bio-7070-exec-8] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table where minute_start = date'2016-08-15 03:20:00' User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' ==========================[QUERY]=============================== 2016-08-15 03:54:17,067 ERROR [http-bio-7070-exec-8] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Illegal DATE literal '2016-08-15 03:20:00': not in format 'yyyy-MM-dd' at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:54:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:54:49,662 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:54:49,664 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table where minute_start = timestamp'2016-08-15 03:20:00' 2016-08-15 03:54:49,665 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table where minute_start = timestamp'2016-08-15 03:20:00' LIMIT 50000 2016-08-15 03:54:49,721 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:54:49,721 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@47871083 2016-08-15 03:54:49,722 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:54:49,722 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:54:49,722 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:54:49,746 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:54:49,751 INFO [http-bio-7070-exec-9] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:54:49,752 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:54:49,755 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:54:49,757 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1182 bytes, rawScanBytesString 120 bytes 2016-08-15 03:54:49,757 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 7979b007 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:54:49,759 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x34\xE0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7FW\xB14\xE0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x34\xE0\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7FW\xB14\xE0\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x34\xE0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x01\x01\x01\x01\x01\x01\x01; 2016-08-15 03:54:49,759 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:54:49,760 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:54:49,761 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:54:49,769 INFO [pool-8-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 28. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.0, server physical mem left: 1.2169216E8, server swap mem left:4.31468544E9.Etc message: start latency: 3@1,agg done@4,compress done@4,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:54:49,769 INFO [pool-8-thread-9] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 28. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.036986983426986274, server physical mem left: 1.2169216E8, server swap mem left:4.31468544E9.Etc message: start latency: 3@1,agg done@3,compress done@3,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:54:49,770 DEBUG [pool-8-thread-10] util.CompressionUtils:67 : Original: 152 bytes. Decompressed: 448 bytes. Time: 0 2016-08-15 03:54:49,770 DEBUG [pool-8-thread-9] util.CompressionUtils:67 : Original: 152 bytes. Decompressed: 448 bytes. Time: 0 2016-08-15 03:54:49,775 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 28, 2016-08-15 03:54:49,775 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 110, total scan count 28 2016-08-15 03:54:49,776 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table where minute_start = timestamp'2016-08-15 03:20:00' User: ADMIN Success: true Duration: 0.11 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 28 Result row count: 28 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:55:29,339 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:55:29,342 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select minute_start, category, qty from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' 2016-08-15 03:55:29,343 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select minute_start, category, qty from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' LIMIT 50000 2016-08-15 03:55:29,394 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:55:29,394 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@5844477f 2016-08-15 03:55:29,395 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:55:29,395 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:55:29,395 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:55:29,423 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:55:29,425 INFO [http-bio-7070-exec-5] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:55:29,426 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:55:29,429 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:55:29,431 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1182 bytes, rawScanBytesString 120 bytes 2016-08-15 03:55:29,431 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 7cd6f2c7 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:55:29,433 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x35\x1C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7FW\xB15\x1C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x35\x1C\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7FW\xB15\x1C\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x35\x1C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x01\x01\x01\x01\x01\x01\x01; 2016-08-15 03:55:29,435 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:55:29,436 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:55:29,438 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:55:29,445 INFO [pool-8-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 27. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.0, server physical mem left: 1.19107584E8, server swap mem left:4.3150336E9.Etc message: start latency: 3@1,agg done@4,compress done@4,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:55:29,446 DEBUG [pool-8-thread-10] util.CompressionUtils:67 : Original: 149 bytes. Decompressed: 432 bytes. Time: 0 2016-08-15 03:55:29,446 INFO [pool-8-thread-9] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 27. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.06235073904343898, server physical mem left: 1.19107584E8, server swap mem left:4.3150336E9.Etc message: start latency: 3@1,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:55:29,447 DEBUG [pool-8-thread-9] util.CompressionUtils:67 : Original: 149 bytes. Decompressed: 432 bytes. Time: 0 2016-08-15 03:55:29,454 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 27, 2016-08-15 03:55:29,455 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 113, total scan count 27 2016-08-15 03:55:29,455 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' User: ADMIN Success: true Duration: 0.113 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 27 Result row count: 27 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:55:36,047 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:55:50,089 INFO [http-bio-7070-exec-4] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:55:50,090 INFO [http-bio-7070-exec-4] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start order by minute_start 2016-08-15 03:55:50,091 INFO [http-bio-7070-exec-4] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start order by minute_start LIMIT 50000 2016-08-15 03:55:50,172 INFO [http-bio-7070-exec-4] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:55:50,172 INFO [http-bio-7070-exec-4] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@7c6decd 2016-08-15 03:55:50,173 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:55:50,173 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:55:50,173 INFO [http-bio-7070-exec-4] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:55:50,231 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:55:50,232 INFO [http-bio-7070-exec-4] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:55:50,234 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:55:50,235 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 315 bytes, rawScanBytesString 76 bytes 2016-08-15 03:55:50,236 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 11116d5f for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:55:50,236 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C (\x00\x00\x00\x00\x00\x00\x00\x00\x00@W\xB15\x1C) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@W\xB15\x1C\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00; 2016-08-15 03:55:50,237 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:55:50,317 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:55:50,318 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:55:50,335 INFO [pool-8-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.3273088E8, server swap mem left:4.301447168E9.Etc message: start latency: 7@1,agg done@4,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:55:50,337 DEBUG [pool-8-thread-10] util.CompressionUtils:67 : Original: 13 bytes. Decompressed: 5 bytes. Time: 0 2016-08-15 03:55:50,337 INFO [pool-8-thread-9] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.03056608387333415, server physical mem left: 1.3273088E8, server swap mem left:4.301447168E9.Etc message: start latency: 5@1,agg done@2,compress done@2,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:55:50,338 DEBUG [pool-8-thread-9] util.CompressionUtils:67 : Original: 13 bytes. Decompressed: 5 bytes. Time: 0 2016-08-15 03:55:50,343 INFO [http-bio-7070-exec-4] service.QueryService:399 : Scan count for each storageContext: 1, 2016-08-15 03:55:50,344 INFO [http-bio-7070-exec-4] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 253, total scan count 1 2016-08-15 03:55:50,345 INFO [http-bio-7070-exec-4] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.253 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 1 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:56:20,372 INFO [http-bio-7070-exec-6] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:56:20,375 INFO [http-bio-7070-exec-6] controller.QueryController:175 : The original query: select minute_start from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' 2016-08-15 03:56:20,376 INFO [http-bio-7070-exec-6] service.QueryService:266 : The corrected query: select minute_start from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' LIMIT 50000 2016-08-15 03:56:20,410 INFO [http-bio-7070-exec-6] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:56:20,410 INFO [http-bio-7070-exec-6] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@58f32df8 2016-08-15 03:56:20,411 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:56:20,411 INFO [http-bio-7070-exec-6] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:56:20,411 INFO [http-bio-7070-exec-6] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:56:20,434 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:56:20,435 INFO [http-bio-7070-exec-6] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 03:56:20,436 INFO [http-bio-7070-exec-6] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:56:20,438 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:56:20,439 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1186 bytes, rawScanBytesString 120 bytes 2016-08-15 03:56:20,439 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:315 : The scan 145a9889 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:56:20,441 INFO [http-bio-7070-exec-6] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x35\x1C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7FW\xB15\x1C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x35\x1C\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7FW\xB15\x1C\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x57\xB1\x35\x1C\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x01\x01\x01\x01\x01\x01\x01; 2016-08-15 03:56:20,441 DEBUG [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:56:20,441 INFO [http-bio-7070-exec-6] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:56:20,442 DEBUG [http-bio-7070-exec-6] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:56:20,450 INFO [pool-8-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 27. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.0, server physical mem left: 1.32067328E8, server swap mem left:4.301733888E9.Etc message: start latency: 2@1,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:56:20,450 INFO [pool-8-thread-9] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 27. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.06553068836893862, server physical mem left: 1.32067328E8, server swap mem left:4.301733888E9.Etc message: start latency: 2@0,agg done@3,compress done@3,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:56:20,450 DEBUG [pool-8-thread-10] util.CompressionUtils:67 : Original: 266 bytes. Decompressed: 567 bytes. Time: 0 2016-08-15 03:56:20,451 DEBUG [pool-8-thread-9] util.CompressionUtils:67 : Original: 266 bytes. Decompressed: 567 bytes. Time: 0 2016-08-15 03:56:20,457 INFO [http-bio-7070-exec-6] service.QueryService:399 : Scan count for each storageContext: 27, 2016-08-15 03:56:20,457 INFO [http-bio-7070-exec-6] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 81, total scan count 27 2016-08-15 03:56:20,458 INFO [http-bio-7070-exec-6] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' User: ADMIN Success: true Duration: 0.081 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 27 Result row count: 27 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:56:36,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:56:57,951 INFO [http-bio-7070-exec-7] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:56:57,952 INFO [http-bio-7070-exec-7] controller.QueryController:175 : The original query: select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start, category, qty 2016-08-15 03:56:57,962 INFO [http-bio-7070-exec-7] service.QueryService:266 : The corrected query: select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start, category, qty LIMIT 50000 2016-08-15 03:56:58,034 INFO [http-bio-7070-exec-7] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:56:58,035 INFO [http-bio-7070-exec-7] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@3e3e3bfb 2016-08-15 03:56:58,035 INFO [http-bio-7070-exec-7] cube.CubeCapabilityChecker:80 : Exclude cube Streaming_Cube because unmatched dimensions 2016-08-15 03:56:58,035 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [] 2016-08-15 03:56:58,036 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [], realizations after: [] 2016-08-15 03:56:58,036 ERROR [http-bio-7070-exec-7] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start, category, qty LIMIT 50000": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START, DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.kylin.query.routing.NoRealizationFoundException: Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START, DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. at org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:66) at org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:80) at org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:102) at org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92) at org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1171) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:297) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more 2016-08-15 03:56:58,039 INFO [http-bio-7070-exec-7] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start, category, qty User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start, category, qty LIMIT 50000": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START, DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. ==========================[QUERY]=============================== 2016-08-15 03:56:58,039 ERROR [http-bio-7070-exec-7] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start, category, qty LIMIT 50000": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START, DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:57:36,014 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:57:42,166 INFO [http-bio-7070-exec-8] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:57:42,168 INFO [http-bio-7070-exec-8] controller.QueryController:175 : The original query: select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start 2016-08-15 03:57:42,168 INFO [http-bio-7070-exec-8] service.QueryService:266 : The corrected query: select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start LIMIT 50000 2016-08-15 03:57:42,187 ERROR [http-bio-7070-exec-8] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start LIMIT 50000": From line 1, column 22 to line 1, column 29: Expression 'CATEGORY' is not being grouped at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 1, column 22 to line 1, column 29: Expression 'CATEGORY' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:110) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:39) at org.apache.calcite.sql.SqlIdentifier.accept(SqlIdentifier.java:307) at org.apache.calcite.sql.validate.AggregatingSelectScope.checkAggregateExpr(AggregatingSelectScope.java:231) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelectList(SqlValidatorImpl.java:3445) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2969) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Expression 'CATEGORY' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 105 more 2016-08-15 03:57:42,190 INFO [http-bio-7070-exec-8] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start LIMIT 50000": From line 1, column 22 to line 1, column 29: Expression 'CATEGORY' is not being grouped ==========================[QUERY]=============================== 2016-08-15 03:57:42,191 ERROR [http-bio-7070-exec-8] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select minute_start, category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start LIMIT 50000": From line 1, column 22 to line 1, column 29: Expression 'CATEGORY' is not being grouped at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:57:47,368 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:57:47,369 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start 2016-08-15 03:57:47,370 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start LIMIT 50000 2016-08-15 03:57:47,411 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:57:47,412 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@51097971 2016-08-15 03:57:47,412 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:57:47,412 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:57:47,413 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:57:47,454 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:57:47,455 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:57:47,456 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:57:47,457 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 315 bytes, rawScanBytesString 76 bytes 2016-08-15 03:57:47,457 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 76ec7948 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:57:47,458 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C (\x00\x00\x00\x00\x00\x00\x00\x00\x00@W\xB15\x1C) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@W\xB15\x1C\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00; 2016-08-15 03:57:47,458 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:57:47,523 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:57:47,524 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:57:47,529 INFO [pool-8-thread-11] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.038736730983520026, server physical mem left: 1.44625664E8, server swap mem left:4.28193792E9.Etc message: start latency: 1@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:57:47,529 DEBUG [pool-8-thread-11] util.CompressionUtils:67 : Original: 13 bytes. Decompressed: 5 bytes. Time: 0 2016-08-15 03:57:47,532 INFO [pool-8-thread-12] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 1.44625664E8, server swap mem left:4.28193792E9.Etc message: start latency: 3@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:57:47,533 DEBUG [pool-8-thread-12] util.CompressionUtils:67 : Original: 13 bytes. Decompressed: 5 bytes. Time: 0 2016-08-15 03:57:47,535 INFO [http-bio-7070-exec-3] service.QueryService:399 : Scan count for each storageContext: 1, 2016-08-15 03:57:47,536 INFO [http-bio-7070-exec-3] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 166, total scan count 1 2016-08-15 03:57:47,536 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by minute_start User: ADMIN Success: true Duration: 0.166 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 1 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:57:58,667 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:57:58,668 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category, qty 2016-08-15 03:57:58,668 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category, qty LIMIT 50000 2016-08-15 03:57:58,715 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:57:58,715 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@4a6811a7 2016-08-15 03:57:58,716 INFO [http-bio-7070-exec-3] cube.CubeCapabilityChecker:80 : Exclude cube Streaming_Cube because unmatched dimensions 2016-08-15 03:57:58,718 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [] 2016-08-15 03:57:58,718 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [], realizations after: [] 2016-08-15 03:57:58,719 ERROR [http-bio-7070-exec-3] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category, qty LIMIT 50000": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.kylin.query.routing.NoRealizationFoundException: Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. at org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:66) at org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:80) at org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:102) at org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92) at org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1171) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:297) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more 2016-08-15 03:57:58,722 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category, qty User: ADMIN Success: false Duration: 0.0 Project: Kafka_Streaming Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category, qty LIMIT 50000": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. ==========================[QUERY]=============================== 2016-08-15 03:57:58,722 ERROR [http-bio-7070-exec-3] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select category, qty, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category, qty LIMIT 50000": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.STREAMING_SALES_TABLE,group by [DEFAULT.STREAMING_SALES_TABLE.CATEGORY, DEFAULT.STREAMING_SALES_TABLE.QTY],filter on [DEFAULT.STREAMING_SALES_TABLE.MINUTE_START],with aggregates[FunctionDesc [expression=COUNT, parameter=null, returnType=null]]. at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 03:58:03,341 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:58:03,342 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category 2016-08-15 03:58:03,344 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category LIMIT 50000 2016-08-15 03:58:03,402 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:58:03,403 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@5d037f87 2016-08-15 03:58:03,403 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:58:03,403 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:58:03,404 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:58:03,471 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:58:03,473 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:58:03,475 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:58:03,476 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 460 bytes, rawScanBytesString 80 bytes 2016-08-15 03:58:03,476 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 39d4e36c for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:58:03,478 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 96 to 96 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x60\x57\xB1\x35\x1C\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00`W\xB15\x1C\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x60\x57\xB1\x35\x1C\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00`W\xB15\x1C\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x60\x57\xB1\x35\x1C\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01; 2016-08-15 03:58:03,479 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:58:03,479 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:58:03,480 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:58:03,493 INFO [pool-8-thread-12] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.06332157742866304, server physical mem left: 1.44289792E8, server swap mem left:4.282126336E9.Etc message: start latency: 7@1,agg done@2,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:58:03,500 DEBUG [pool-8-thread-12] util.CompressionUtils:67 : Original: 27 bytes. Decompressed: 30 bytes. Time: 1 2016-08-15 03:58:03,500 INFO [pool-8-thread-11] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.0, server physical mem left: 1.44289792E8, server swap mem left:4.282126336E9.Etc message: start latency: 7@1,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:58:03,503 DEBUG [pool-8-thread-11] util.CompressionUtils:67 : Original: 27 bytes. Decompressed: 30 bytes. Time: 0 2016-08-15 03:58:03,512 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 03:58:03,519 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 175, total scan count 5 2016-08-15 03:58:03,520 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category User: ADMIN Success: true Duration: 0.175 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [96] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:58:25,236 INFO [http-bio-7070-exec-4] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:58:25,237 INFO [http-bio-7070-exec-4] controller.QueryController:175 : The original query: select count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' --group by category 2016-08-15 03:58:25,237 INFO [http-bio-7070-exec-4] service.QueryService:266 : The corrected query: select count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' --group by category LIMIT 50000 2016-08-15 03:58:25,288 INFO [http-bio-7070-exec-4] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:58:25,289 INFO [http-bio-7070-exec-4] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@28ec8c90 2016-08-15 03:58:25,289 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:58:25,290 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:58:25,290 INFO [http-bio-7070-exec-4] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:58:25,342 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:58:25,344 INFO [http-bio-7070-exec-4] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:58:25,346 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:58:25,347 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 314 bytes, rawScanBytesString 76 bytes 2016-08-15 03:58:25,348 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 3f72de8c for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:58:25,349 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 64 to 64 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C (\x00\x00\x00\x00\x00\x00\x00\x00\x00@W\xB15\x1C) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00@W\xB15\x1C\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x57\xB1\x35\x1C \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00; 2016-08-15 03:58:25,349 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:58:25,350 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:58:25,350 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:58:25,357 INFO [pool-8-thread-11] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.06687748887327243, server physical mem left: 1.41524992E8, server swap mem left:4.282359808E9.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:58:25,358 DEBUG [pool-8-thread-11] util.CompressionUtils:67 : Original: 13 bytes. Decompressed: 5 bytes. Time: 0 2016-08-15 03:58:25,362 INFO [http-bio-7070-exec-4] service.QueryService:399 : Scan count for each storageContext: 1, 2016-08-15 03:58:25,362 INFO [pool-8-thread-12] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 1.0, server physical mem left: 1.41524992E8, server swap mem left:4.282359808E9.Etc message: start latency: 2@1,agg done@3,compress done@3,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:58:25,363 DEBUG [pool-8-thread-12] util.CompressionUtils:67 : Original: 13 bytes. Decompressed: 5 bytes. Time: 0 2016-08-15 03:58:25,363 INFO [http-bio-7070-exec-4] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 126, total scan count 1 2016-08-15 03:58:25,364 INFO [http-bio-7070-exec-4] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' --group by category User: ADMIN Success: true Duration: 0.126 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [64] Total scan count: 1 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:58:32,049 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 03:58:32,050 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category 2016-08-15 03:58:32,050 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category LIMIT 50000 2016-08-15 03:58:32,107 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 03:58:32,108 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@77163bff 2016-08-15 03:58:32,108 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:58:32,109 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 03:58:32,109 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 03:58:32,159 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 03:58:32,160 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 03:58:32,162 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 03:58:32,162 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 460 bytes, rawScanBytesString 80 bytes 2016-08-15 03:58:32,163 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 55d54cef for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 03:58:32,164 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 96 to 96 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x60\x57\xB1\x35\x1C\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00`W\xB15\x1C\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x60\x57\xB1\x35\x1C\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00`W\xB15\x1C\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x60\x57\xB1\x35\x1C\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01; 2016-08-15 03:58:32,164 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 03:58:32,164 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 03:58:32,170 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 03:58:32,176 INFO [pool-8-thread-12] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.03332085361287907, server physical mem left: 1.41139968E8, server swap mem left:4.282482688E9.Etc message: start latency: 6@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:58:32,177 INFO [pool-8-thread-11] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 1.41139968E8, server swap mem left:4.282482688E9.Etc message: start latency: 6@1,agg done@2,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 03:58:32,181 DEBUG [pool-8-thread-11] util.CompressionUtils:67 : Original: 27 bytes. Decompressed: 30 bytes. Time: 0 2016-08-15 03:58:32,181 DEBUG [pool-8-thread-12] util.CompressionUtils:67 : Original: 27 bytes. Decompressed: 30 bytes. Time: 0 2016-08-15 03:58:32,184 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 03:58:32,185 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 135, total scan count 5 2016-08-15 03:58:32,187 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table where minute_start = timestamp'2016-08-15 03:21:00' group by category User: ADMIN Success: true Duration: 0.135 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [96] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 03:58:36,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 03:59:09,839 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:59:13,181 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:59:13,197 DEBUG [http-bio-7070-exec-4] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 03:59:13,316 DEBUG [http-bio-7070-exec-4] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 03:59:13,484 INFO [http-bio-7070-exec-7] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 03:59:36,027 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:00:36,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:01:36,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:01:38,774 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:01:38,812 DEBUG [http-bio-7070-exec-5] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:01:38,933 DEBUG [http-bio-7070-exec-4] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:01:39,024 INFO [http-bio-7070-exec-2] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 04:02:36,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:03:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:04:36,060 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:05:36,052 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:06:08,864 INFO [http-bio-7070-exec-1] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 04:06:08,866 INFO [http-bio-7070-exec-1] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 04:06:08,870 DEBUG [http-bio-7070-exec-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 2 segments:KYLIN_3ST7A64L6P,KYLIN_X6P15BH8BV 2016-08-15 04:06:08,873 INFO [http-bio-7070-exec-1] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:06:08,873 INFO [http-bio-7070-exec-1] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:06:08,873 DEBUG [http-bio-7070-exec-1] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:06:08,873 DEBUG [http-bio-7070-exec-1] service.CubeService:591 : server mode: all 2016-08-15 04:06:08,874 INFO [http-bio-7070-exec-1] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:06:08,875 DEBUG [http-bio-7070-exec-1] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:06:36,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:07:36,032 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:07:52,082 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:07:52,125 DEBUG [http-bio-7070-exec-6] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:07:52,277 DEBUG [http-bio-7070-exec-6] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:07:52,402 INFO [http-bio-7070-exec-2] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 04:07:52,408 INFO [http-bio-7070-exec-2] controller.TableController:95 : Return all table metadata in 7 seconds 2016-08-15 04:07:55,229 INFO [http-bio-7070-exec-2] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_X6P15BH8BV". 2016-08-15 04:08:32,220 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:08:32,304 DEBUG [http-bio-7070-exec-9] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:08:32,418 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:08:32,532 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 04:08:36,043 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:08:54,727 INFO [http-bio-7070-exec-1] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:08:54,729 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 3 seconds 2016-08-15 04:09:31,400 INFO [http-bio-7070-exec-10] cube.CubeManager:321 : Updating cube instance 'Test_Cube' 2016-08-15 04:09:31,409 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /cube/Test_Cube.json from oldTs: 1471051700169, to newTs: 1471234171401, operation result: true 2016-08-15 04:09:31,410 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Test_Cube, action=update} 2016-08-15 04:09:31,417 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_ZYW9RTGGF0 2016-08-15 04:09:31,418 INFO [http-bio-7070-exec-9] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Test_Cube 2016-08-15 04:09:31,419 INFO [http-bio-7070-exec-9] service.CacheService:171 : rebuild cache type: CUBE name:Test_Cube 2016-08-15 04:09:31,420 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:31,421 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for 4c9c6fb0-892c-4487-a108-f27487f33e1b (currently remove all entries) 2016-08-15 04:09:31,421 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:09:31,421 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 04:09:31,422 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:09:31,422 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:09:31,422 DEBUG [http-bio-7070-exec-9] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_ZYW9RTGGF0 2016-08-15 04:09:31,425 INFO [http-bio-7070-exec-9] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:31,425 INFO [http-bio-7070-exec-9] service.CacheService:106 : cleaning cache for 4c9c6fb0-892c-4487-a108-f27487f33e1b (currently remove all entries) 2016-08-15 04:09:31,429 DEBUG [http-bio-7070-exec-9] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:09:31,430 DEBUG [http-bio-7070-exec-9] service.CubeService:591 : server mode: all 2016-08-15 04:09:31,431 INFO [http-bio-7070-exec-9] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:09:31,432 DEBUG [http-bio-7070-exec-9] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:09:35,619 INFO [http-bio-7070-exec-2] cube.CubeManager:321 : Updating cube instance 'Test_Cube' 2016-08-15 04:09:35,624 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /cube/Test_Cube.json from oldTs: 1471234171401, to newTs: 1471234175620, operation result: true 2016-08-15 04:09:35,624 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Test_Cube/0b0fc913-462a-4af2-b4f8-81bdbf219594.seq (Store kylin_metadata@hbase) 2016-08-15 04:09:35,628 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Test_Cube, action=update} 2016-08-15 04:09:35,631 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 0 segments: 2016-08-15 04:09:35,632 INFO [http-bio-7070-exec-4] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Test_Cube 2016-08-15 04:09:35,632 INFO [http-bio-7070-exec-4] service.CacheService:171 : rebuild cache type: CUBE name:Test_Cube 2016-08-15 04:09:35,633 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:35,634 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for 4c9c6fb0-892c-4487-a108-f27487f33e1b (currently remove all entries) 2016-08-15 04:09:35,634 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:09:35,635 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 04:09:35,635 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:09:35,635 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 0 segments: 2016-08-15 04:09:35,635 DEBUG [http-bio-7070-exec-2] cube.CubeManager:639 : Cube Test_Cube has no ready segment to merge 2016-08-15 04:09:35,636 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:09:35,636 INFO [http-bio-7070-exec-2] cube.CubeManager:227 : Dropping cube 'Test_Cube' 2016-08-15 04:09:35,637 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube_desc/Test_Cube.json (Store kylin_metadata@hbase) 2016-08-15 04:09:35,638 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:35,639 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for 4c9c6fb0-892c-4487-a108-f27487f33e1b (currently remove all entries) 2016-08-15 04:09:35,639 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:09:35,640 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 04:09:35,640 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube_desc, name=Test_Cube, action=drop} 2016-08-15 04:09:35,640 DEBUG [http-bio-7070-exec-2] persistence.ResourceStore:260 : Deleting resource /cube/Test_Cube.json (Store kylin_metadata@hbase) 2016-08-15 04:09:35,640 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:09:35,641 ERROR [http-bio-7070-exec-4] controller.BasicController:44 : java.lang.NullPointerException at org.apache.kylin.rest.service.CubeService.keepCubeRetention(CubeService.java:603) at org.apache.kylin.rest.service.CubeService.updateOnNewSegmentReady(CubeService.java:593) at org.apache.kylin.rest.service.CubeService$$FastClassByCGLIB$$17a07c0e.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.CubeService$$EnhancerByCGLIB$$db05f8ef.updateOnNewSegmentReady() at org.apache.kylin.rest.service.CacheService.rebuildCubeCache(CacheService.java:246) at org.apache.kylin.rest.service.CacheService.rebuildCache(CacheService.java:175) at org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:800) at javax.servlet.http.HttpServlet.service(HttpServlet.java:649) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 04:09:35,644 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Test_Cube, action=drop} 2016-08-15 04:09:35,647 WARN [pool-7-thread-1] restclient.Broadcaster:109 : Thread failed during wipe cache at BroadcastEvent{type=cube, name=Test_Cube, action=update} 2016-08-15 04:09:35,651 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: CUBE_DESC event:DROP name:Test_Cube 2016-08-15 04:09:35,794 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: CUBE event:DROP name:Test_Cube 2016-08-15 04:09:35,799 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1470993241900, to newTs: 1471234175790, operation result: true 2016-08-15 04:09:35,799 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for 4c9c6fb0-892c-4487-a108-f27487f33e1b (currently remove all entries) 2016-08-15 04:09:35,799 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:09:35,804 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:09:35,804 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:09:35,807 DEBUG [http-bio-7070-exec-2] service.AclService:268 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.cube.CubeInstance; Identifier: 4c9c6fb0-892c-4487-a108-f27487f33e1b] deleted successfully. 2016-08-15 04:09:35,807 INFO [http-bio-7070-exec-6] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:36,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:09:39,023 INFO [http-bio-7070-exec-7] invertedindex.IIDescManager:88 : Initializing IIDescManager with config kylin_metadata@hbase 2016-08-15 04:09:39,023 INFO [http-bio-7070-exec-7] invertedindex.IIDescManager:179 : Reloading all II desc from folder kylin_metadata(key='/invertedindex_desc')@kylin_metadata@hbase 2016-08-15 04:09:39,037 DEBUG [http-bio-7070-exec-7] invertedindex.IIDescManager:205 : Loaded 0 II desc(s) 2016-08-15 04:09:39,038 INFO [http-bio-7070-exec-7] metadata.MetadataManager:462 : Dropping model 'Test_Model' 2016-08-15 04:09:39,038 DEBUG [http-bio-7070-exec-7] persistence.ResourceStore:260 : Deleting resource /model_desc/Test_Model.json (Store kylin_metadata@hbase) 2016-08-15 04:09:39,049 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1471234175790, to newTs: 1471234179043, operation result: true 2016-08-15 04:09:39,049 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:09:39,051 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=data_model, name=Test_Model, action=drop} 2016-08-15 04:09:39,051 DEBUG [http-bio-7070-exec-7] service.AclService:268 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: 5adbbf81-3c17-4164-b83f-029a3add09e0] deleted successfully. 2016-08-15 04:09:39,056 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:09:39,056 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:09:39,062 INFO [http-bio-7070-exec-6] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:39,068 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: DATA_MODEL event:DROP name:Test_Model 2016-08-15 04:09:41,005 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:09:41,033 DEBUG [http-bio-7070-exec-1] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:09:41,152 DEBUG [http-bio-7070-exec-5] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:09:41,278 INFO [http-bio-7070-exec-3] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:09:41,279 INFO [http-bio-7070-exec-3] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:09:57,036 DEBUG [http-bio-7070-exec-3] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1471234179043, to newTs: 1471234197028, operation result: true 2016-08-15 04:09:57,037 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:09:57,045 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:09:57,046 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:09:57,056 INFO [http-bio-7070-exec-6] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:09:57,115 INFO [http-bio-7070-exec-5] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:09:57,116 INFO [http-bio-7070-exec-5] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:10:05,065 DEBUG [http-bio-7070-exec-1] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1471234197028, to newTs: 1471234205060, operation result: true 2016-08-15 04:10:05,065 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:10:05,076 INFO [http-bio-7070-exec-4] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:10:05,077 INFO [http-bio-7070-exec-4] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:10:05,083 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:10:05,176 INFO [http-bio-7070-exec-1] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:10:05,177 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:10:36,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:11:24,906 DEBUG [http-bio-7070-exec-7] controller.StreamingController:223 : Saving TableDesc {"name":"STREAMING_SALES_TABLE_60","source_type":1,"columns":[{"id":1,"name":"amount","datatype":"decimal"},{"id":2,"name":"qty","datatype":"int"},{"id":3,"name":"order_time","datatype":"timestamp"},{"id":4,"name":"category","datatype":"varchar(256)"},{"id":5,"name":"device","datatype":"varchar(256)"},{"id":6,"name":"currency","datatype":"varchar(256)"},{"id":7,"name":"country","datatype":"varchar(256)"},{"id":8,"name":"year_start","datatype":"date"},{"id":9,"name":"quarter_start","datatype":"date"},{"id":10,"name":"month_start","datatype":"date"},{"id":11,"name":"week_start","datatype":"date"},{"id":12,"name":"day_start","datatype":"date"},{"id":13,"name":"hour_start","datatype":"timestamp"},{"id":14,"name":"minute_start","datatype":"timestamp"}],"database":"Default"} 2016-08-15 04:11:24,909 DEBUG [http-bio-7070-exec-7] controller.StreamingController:246 : Saving StreamingConfig {"name":"STREAMING_SALES_TABLE_60","type":"kafka"} 2016-08-15 04:11:24,911 DEBUG [http-bio-7070-exec-7] controller.StreamingController:265 : Saving KafkaConfig {"name":"STREAMING_SALES_TABLE_60","topic":"kylin_demo","timeout":"60000","bufferSize":"65536","parserName":"org.apache.kylin.source.kafka.TimedJsonStreamParser","margin":"60000","clusters":[{"brokers":[{"id":"1","host":"sandbox","port":"6667"}]}],"parserProperties":"tsColName=order_time"} 2016-08-15 04:11:24,928 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /table/DEFAULT.STREAMING_SALES_TABLE_60.json from oldTs: 0, to newTs: 1471234284920, operation result: true 2016-08-15 04:11:24,928 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=table, name=DEFAULT.STREAMING_SALES_TABLE_60, action=create} 2016-08-15 04:11:24,938 INFO [http-bio-7070-exec-2] controller.CacheController:64 : wipe cache type: TABLE event:CREATE name:DEFAULT.STREAMING_SALES_TABLE_60 2016-08-15 04:11:24,938 INFO [http-bio-7070-exec-2] service.CacheService:171 : rebuild cache type: TABLE name:DEFAULT.STREAMING_SALES_TABLE_60 2016-08-15 04:11:24,941 WARN [http-bio-7070-exec-2] metadata.MetadataManager:271 : Failed to get table exd info from /table_exd/DEFAULT.STREAMING_SALES_TABLE_60.json 2016-08-15 04:11:24,942 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1471234205060, to newTs: 1471234284929, operation result: true 2016-08-15 04:11:24,943 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:11:24,952 INFO [http-bio-7070-exec-3] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:11:24,953 INFO [http-bio-7070-exec-3] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:11:24,956 INFO [http-bio-7070-exec-3] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:11:24,966 INFO [http-bio-7070-exec-7] streaming.StreamingManager:218 : Reloading Streaming Metadata from folder kylin_metadata(key='/streaming')@kylin_metadata@hbase 2016-08-15 04:11:24,996 DEBUG [http-bio-7070-exec-7] streaming.StreamingManager:243 : Loaded 1 StreamingConfig(s) 2016-08-15 04:11:25,005 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /streaming/DEFAULT.STREAMING_SALES_TABLE_60.json from oldTs: 0, to newTs: 1471234284997, operation result: true 2016-08-15 04:11:25,006 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=streaming, name=DEFAULT.STREAMING_SALES_TABLE_60, action=create} 2016-08-15 04:11:25,009 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: STREAMING event:CREATE name:DEFAULT.STREAMING_SALES_TABLE_60 2016-08-15 04:11:25,010 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: STREAMING name:DEFAULT.STREAMING_SALES_TABLE_60 2016-08-15 04:11:25,025 INFO [http-bio-7070-exec-7] kafka.KafkaConfigManager:204 : Reloading Kafka Metadata from folder kylin_metadata(key='/kafka')@kylin_metadata@hbase 2016-08-15 04:11:25,042 DEBUG [http-bio-7070-exec-7] kafka.KafkaConfigManager:229 : Loaded 1 KafkaConfig(s) 2016-08-15 04:11:25,050 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /kafka/DEFAULT.STREAMING_SALES_TABLE_60.json from oldTs: 0, to newTs: 1471234285043, operation result: true 2016-08-15 04:11:25,051 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=kafka, name=DEFAULT.STREAMING_SALES_TABLE_60, action=create} 2016-08-15 04:11:25,056 INFO [http-bio-7070-exec-4] controller.CacheController:64 : wipe cache type: KAFKA event:CREATE name:DEFAULT.STREAMING_SALES_TABLE_60 2016-08-15 04:11:25,056 INFO [http-bio-7070-exec-4] service.CacheService:171 : rebuild cache type: KAFKA name:DEFAULT.STREAMING_SALES_TABLE_60 2016-08-15 04:11:25,120 INFO [http-bio-7070-exec-7] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:11:25,120 INFO [http-bio-7070-exec-7] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 04:11:34,512 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:11:36,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:11:41,379 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:11:44,074 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:11,608 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:15,831 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:25,850 DEBUG [http-bio-7070-exec-7] controller.ModelController:199 : Saving MODEL { "name": "Test_Model", "description": "", "fact_table": "DEFAULT.STREAMING_SALES_TABLE_60", "lookups": [], "filter_condition": "", "capacity": "MEDIUM", "dimensions": [ { "table": "DEFAULT.STREAMING_SALES_TABLE_60", "columns": [ "ORDER_TIME", "CATEGORY", "DEVICE", "CURRENCY", "COUNTRY", "MINUTE_START", "HOUR_START", "DAY_START" ] } ], "metrics": [ "AMOUNT", "QTY" ], "partition_desc": { "partition_date_column": "DEFAULT.STREAMING_SALES_TABLE_60.MINUTE_START", "partition_date_start": null, "partition_type": "APPEND", "partition_date_format": "yyyy-MM-dd HH:mm:ss", "partition_time_column": null, "partition_time_start": null }, "last_modified": 0 } 2016-08-15 04:12:25,857 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1471234284929, to newTs: 1471234345851, operation result: true 2016-08-15 04:12:25,857 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:12:25,861 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:12:25,861 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:12:25,866 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:12:25,871 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /model_desc/Test_Model.json from oldTs: 0, to newTs: 1471234345858, operation result: true 2016-08-15 04:12:25,871 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=data_model, name=Test_Model, action=create} 2016-08-15 04:12:25,876 INFO [http-bio-7070-exec-9] controller.CacheController:64 : wipe cache type: DATA_MODEL event:CREATE name:Test_Model 2016-08-15 04:12:25,876 INFO [http-bio-7070-exec-9] service.CacheService:171 : rebuild cache type: DATA_MODEL name:Test_Model 2016-08-15 04:12:25,876 DEBUG [http-bio-7070-exec-7] service.AclService:239 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: e7ec4c6d-92f0-45bd-a68a-01261decf2c7] created successfully. 2016-08-15 04:12:25,881 DEBUG [http-bio-7070-exec-7] service.AclService:306 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: e7ec4c6d-92f0-45bd-a68a-01261decf2c7] updated successfully. 2016-08-15 04:12:25,886 DEBUG [http-bio-7070-exec-7] service.AclService:239 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.project.ProjectInstance; Identifier: b5c8de2a-2a92-4044-a3fe-4e73ef8240c1] created successfully. 2016-08-15 04:12:25,887 DEBUG [http-bio-7070-exec-7] service.AclService:306 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.metadata.model.DataModelDesc; Identifier: e7ec4c6d-92f0-45bd-a68a-01261decf2c7] updated successfully. 2016-08-15 04:12:26,104 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:26,787 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:26,812 DEBUG [http-bio-7070-exec-7] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:12:26,926 DEBUG [http-bio-7070-exec-1] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:27,007 INFO [http-bio-7070-exec-7] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:12:27,008 INFO [http-bio-7070-exec-7] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:12:28,587 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:28,661 INFO [http-bio-7070-exec-2] cube.CubeDescManager:91 : Initializing CubeDescManager with config kylin_metadata@hbase 2016-08-15 04:12:28,662 INFO [http-bio-7070-exec-2] cube.CubeDescManager:197 : Reloading Cube Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase 2016-08-15 04:12:28,733 DEBUG [http-bio-7070-exec-2] cube.CubeDescManager:222 : Loaded 5 Cube(s) 2016-08-15 04:12:32,053 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:32,055 DEBUG [http-bio-7070-exec-2] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:12:36,022 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:12:43,282 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:13:08,374 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:13:36,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:14:09,173 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:14:22,711 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:14:28,700 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:14:29,715 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:14:32,953 DEBUG [http-bio-7070-exec-1] controller.CubeController:558 : Saving cube { "name": "Test_Cube", "model_name": "Test_Model", "description": "", "dimensions": [ { "name": "DEFAULT.STREAMING_SALES_TABLE_60.CATEGORY", "table": "DEFAULT.STREAMING_SALES_TABLE_60", "derived": null, "column": "CATEGORY" }, { "name": "DEFAULT.STREAMING_SALES_TABLE_60.DEVICE", "table": "DEFAULT.STREAMING_SALES_TABLE_60", "derived": null, "column": "DEVICE" }, { "name": "DEFAULT.STREAMING_SALES_TABLE_60.CURRENCY", "table": "DEFAULT.STREAMING_SALES_TABLE_60", "derived": null, "column": "CURRENCY" }, { "name": "DEFAULT.STREAMING_SALES_TABLE_60.COUNTRY", "table": "DEFAULT.STREAMING_SALES_TABLE_60", "derived": null, "column": "COUNTRY" }, { "name": "DEFAULT.STREAMING_SALES_TABLE_60.MINUTE_START", "table": "DEFAULT.STREAMING_SALES_TABLE_60", "derived": null, "column": "MINUTE_START" } ], "measures": [ { "name": "_COUNT_", "function": { "expression": "COUNT", "returntype": "bigint", "parameter": { "type": "constant", "value": "1", "next_parameter": null } } } ], "rowkey": { "rowkey_columns": [ { "column": "MINUTE_START", "encoding": "dict", "isShardBy": "false" }, { "column": "CATEGORY", "encoding": "dict", "isShardBy": "false" }, { "column": "DEVICE", "encoding": "dict", "isShardBy": "false" }, { "column": "CURRENCY", "encoding": "dict", "isShardBy": "false" }, { "column": "COUNTRY", "encoding": "dict", "isShardBy": "false" } ] }, "aggregation_groups": [ { "includes": [ "CATEGORY", "DEVICE", "CURRENCY", "COUNTRY", "MINUTE_START" ], "select_rule": { "hierarchy_dims": [], "mandatory_dims": [], "joint_dims": [] } } ], "partition_date_start": 0, "notify_list": [], "hbase_mapping": { "column_family": [ { "name": "f1", "columns": [ { "qualifier": "m", "measure_refs": [ "_COUNT_" ] } ] } ] }, "retention_range": "0", "status_need_notify": [ "ERROR", "DISCARDED", "SUCCEED" ], "auto_merge_time_ranges": [ 604800000, 2419200000 ], "engine_type": 2, "storage_type": 2 } 2016-08-15 04:14:32,996 DEBUG [http-bio-7070-exec-1] hbase.HBaseResourceStore:262 : Update row /cube_desc/Test_Cube.json from oldTs: 0, to newTs: 1471234472981, operation result: true 2016-08-15 04:14:32,996 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube_desc, name=Test_Cube, action=create} 2016-08-15 04:14:33,009 INFO [http-bio-7070-exec-10] controller.CacheController:64 : wipe cache type: CUBE_DESC event:CREATE name:Test_Cube 2016-08-15 04:14:33,009 INFO [http-bio-7070-exec-10] service.CacheService:171 : rebuild cache type: CUBE_DESC name:Test_Cube 2016-08-15 04:14:33,010 INFO [http-bio-7070-exec-1] service.CubeService:182 : New cube Test_Cube has 31 cuboids 2016-08-15 04:14:33,011 INFO [http-bio-7070-exec-1] cube.CubeManager:252 : Creating cube 'test_kylin-->Test_Cube' from desc 'Test_Cube' 2016-08-15 04:14:33,011 INFO [http-bio-7070-exec-1] cube.CubeManager:321 : Updating cube instance 'Test_Cube' 2016-08-15 04:14:33,024 DEBUG [http-bio-7070-exec-1] hbase.HBaseResourceStore:262 : Update row /cube/Test_Cube.json from oldTs: 0, to newTs: 1471234473012, operation result: true 2016-08-15 04:14:33,024 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Test_Cube, action=create} 2016-08-15 04:14:33,030 DEBUG [http-bio-7070-exec-1] hbase.HBaseResourceStore:262 : Update row /project/test_kylin.json from oldTs: 1471234345851, to newTs: 1471234473024, operation result: true 2016-08-15 04:14:33,031 INFO [http-bio-7070-exec-5] controller.CacheController:64 : wipe cache type: CUBE event:CREATE name:Test_Cube 2016-08-15 04:14:33,034 INFO [http-bio-7070-exec-5] service.CacheService:171 : rebuild cache type: CUBE name:Test_Cube 2016-08-15 04:14:33,035 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=project, name=test_kylin, action=update} 2016-08-15 04:14:33,035 DEBUG [http-bio-7070-exec-1] service.AclService:239 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.cube.CubeInstance; Identifier: 9cf32f8b-dc7e-461c-8b64-927eb01485d4] created successfully. 2016-08-15 04:14:33,037 DEBUG [http-bio-7070-exec-1] service.AclService:306 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.cube.CubeInstance; Identifier: 9cf32f8b-dc7e-461c-8b64-927eb01485d4] updated successfully. 2016-08-15 04:14:33,040 DEBUG [http-bio-7070-exec-5] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 0 segments: 2016-08-15 04:14:33,043 DEBUG [http-bio-7070-exec-1] service.AclService:306 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.cube.CubeInstance; Identifier: 9cf32f8b-dc7e-461c-8b64-927eb01485d4] updated successfully. 2016-08-15 04:14:33,045 INFO [http-bio-7070-exec-5] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:14:33,045 INFO [http-bio-7070-exec-5] service.CacheService:106 : cleaning cache for 9cf32f8b-dc7e-461c-8b64-927eb01485d4 (currently remove all entries) 2016-08-15 04:14:33,046 DEBUG [http-bio-7070-exec-5] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:14:33,046 DEBUG [http-bio-7070-exec-5] service.CubeService:591 : server mode: all 2016-08-15 04:14:33,046 INFO [http-bio-7070-exec-5] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:14:33,046 DEBUG [http-bio-7070-exec-5] cube.CubeManager:639 : Cube Test_Cube has no ready segment to merge 2016-08-15 04:14:33,047 DEBUG [http-bio-7070-exec-5] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:14:33,072 INFO [http-bio-7070-exec-5] controller.CacheController:64 : wipe cache type: PROJECT event:UPDATE name:test_kylin 2016-08-15 04:14:33,073 INFO [http-bio-7070-exec-5] service.CacheService:171 : rebuild cache type: PROJECT name:test_kylin 2016-08-15 04:14:33,082 INFO [http-bio-7070-exec-5] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:14:33,388 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:14:36,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:15:36,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:16:36,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:17:36,041 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:18:36,029 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:19:36,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:20:36,105 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:20:39,104 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:20:39,126 DEBUG [http-bio-7070-exec-1] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:20:39,255 DEBUG [http-bio-7070-exec-6] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:20:39,358 INFO [http-bio-7070-exec-9] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:20:39,359 INFO [http-bio-7070-exec-9] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:21:36,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:21:37,239 INFO [http-bio-7070-exec-2] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 04:21:37,240 INFO [http-bio-7070-exec-2] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 04:21:37,244 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 3 segments:KYLIN_3ST7A64L6P,KYLIN_X6P15BH8BV,KYLIN_7WCZUHE9ZW 2016-08-15 04:21:37,247 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:21:37,247 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:21:37,247 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:21:37,247 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 04:21:37,248 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:21:37,248 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:22:36,091 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:23:36,010 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:23:36,068 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:23:36,182 DEBUG [http-bio-7070-exec-3] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:23:36,314 DEBUG [http-bio-7070-exec-2] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:23:41,390 INFO [http-bio-7070-exec-4] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_7WCZUHE9ZW". 2016-08-15 04:23:54,428 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:23:54,429 DEBUG [http-bio-7070-exec-10] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:23:54,555 DEBUG [http-bio-7070-exec-5] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:24:36,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:24:40,192 INFO [http-bio-7070-exec-3] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Test_Cube 2016-08-15 04:24:40,193 INFO [http-bio-7070-exec-3] service.CacheService:171 : rebuild cache type: CUBE name:Test_Cube 2016-08-15 04:24:40,197 DEBUG [http-bio-7070-exec-3] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_KJLIL0DRNL 2016-08-15 04:24:40,201 INFO [http-bio-7070-exec-3] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:24:40,202 INFO [http-bio-7070-exec-3] service.CacheService:106 : cleaning cache for 9cf32f8b-dc7e-461c-8b64-927eb01485d4 (currently remove all entries) 2016-08-15 04:24:40,203 DEBUG [http-bio-7070-exec-3] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:24:40,203 DEBUG [http-bio-7070-exec-3] service.CubeService:591 : server mode: all 2016-08-15 04:24:40,204 INFO [http-bio-7070-exec-3] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:24:40,205 DEBUG [http-bio-7070-exec-3] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:25:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:26:36,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:27:36,018 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:28:36,029 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:29:30,198 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:29:30,218 DEBUG [http-bio-7070-exec-7] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:29:30,322 DEBUG [http-bio-7070-exec-6] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:29:36,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:29:38,597 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_KJLIL0DRNL". 2016-08-15 04:30:27,494 INFO [http-bio-7070-exec-10] cube.CubeManager:321 : Updating cube instance 'Test_Cube' 2016-08-15 04:30:27,500 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /cube/Test_Cube.json from oldTs: 1471235080045, to newTs: 1471235427494, operation result: true 2016-08-15 04:30:27,500 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Test_Cube, action=update} 2016-08-15 04:30:27,503 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_KJLIL0DRNL 2016-08-15 04:30:27,504 INFO [http-bio-7070-exec-7] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Test_Cube 2016-08-15 04:30:27,504 INFO [http-bio-7070-exec-7] service.CacheService:171 : rebuild cache type: CUBE name:Test_Cube 2016-08-15 04:30:27,505 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:30:27,506 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for 9cf32f8b-dc7e-461c-8b64-927eb01485d4 (currently remove all entries) 2016-08-15 04:30:27,506 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:30:27,506 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 04:30:27,506 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:30:27,507 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_KJLIL0DRNL 2016-08-15 04:30:27,507 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:30:27,509 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project test_kylin 2016-08-15 04:30:27,510 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for 9cf32f8b-dc7e-461c-8b64-927eb01485d4 (currently remove all entries) 2016-08-15 04:30:27,510 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Test_Cube 2016-08-15 04:30:27,510 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 04:30:27,511 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:30:27,511 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Test_Cube 2016-08-15 04:30:36,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:30:41,099 DEBUG [http-bio-7070-exec-9] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 04:30:41,100 INFO [http-bio-7070-exec-9] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:30:41,102 INFO [http-bio-7070-exec-9] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "TEST_KYLIN" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 04:30:41,103 DEBUG [http-bio-7070-exec-9] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "TEST_KYLIN" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 04:30:41,116 DEBUG [http-bio-7070-exec-9] service.QueryService:291 : getting table metas 2016-08-15 04:30:41,117 DEBUG [http-bio-7070-exec-9] service.QueryService:309 : getting column metas 2016-08-15 04:30:41,122 DEBUG [http-bio-7070-exec-9] service.QueryService:323 : done column metas 2016-08-15 04:30:42,755 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:30:42,756 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table 2016-08-15 04:30:42,757 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table LIMIT 50000 2016-08-15 04:30:42,787 ERROR [http-bio-7070-exec-9] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select category, count(*) from streaming_sales_table LIMIT 50000": From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:106) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2757) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2742) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2960) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table 'STREAMING_SALES_TABLE' not found at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 106 more 2016-08-15 04:30:42,794 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table User: ADMIN Success: false Duration: 0.0 Project: test_kylin Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select category, count(*) from streaming_sales_table LIMIT 50000": From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found ==========================[QUERY]=============================== 2016-08-15 04:30:42,795 ERROR [http-bio-7070-exec-9] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select category, count(*) from streaming_sales_table LIMIT 50000": From line 2, column 6 to line 2, column 26: Table 'STREAMING_SALES_TABLE' not found at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 04:30:51,514 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:30:51,515 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table_60 2016-08-15 04:30:51,515 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table_60 LIMIT 50000 2016-08-15 04:30:51,531 ERROR [http-bio-7070-exec-3] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select category, count(*) from streaming_sales_table_60 LIMIT 50000": From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:110) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:39) at org.apache.calcite.sql.SqlIdentifier.accept(SqlIdentifier.java:307) at org.apache.calcite.sql.validate.AggregatingSelectScope.checkAggregateExpr(AggregatingSelectScope.java:231) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelectList(SqlValidatorImpl.java:3445) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2969) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Expression 'CATEGORY' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 105 more 2016-08-15 04:30:51,533 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table_60 User: ADMIN Success: false Duration: 0.0 Project: test_kylin Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select category, count(*) from streaming_sales_table_60 LIMIT 50000": From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped ==========================[QUERY]=============================== 2016-08-15 04:30:51,533 ERROR [http-bio-7070-exec-3] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select category, count(*) from streaming_sales_table_60 LIMIT 50000": From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 04:31:03,956 INFO [http-bio-7070-exec-8] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:31:03,958 INFO [http-bio-7070-exec-8] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' group by category 2016-08-15 04:31:03,958 INFO [http-bio-7070-exec-8] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' group by category LIMIT 50000 2016-08-15 04:31:03,989 INFO [http-bio-7070-exec-8] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:31:03,989 INFO [http-bio-7070-exec-8] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@58da4f4 2016-08-15 04:31:03,990 INFO [http-bio-7070-exec-8] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:31:03,990 INFO [http-bio-7070-exec-8] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:31:03,990 INFO [http-bio-7070-exec-8] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:31:04,027 DEBUG [http-bio-7070-exec-8] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:31:04,028 INFO [http-bio-7070-exec-8] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:31:04,028 INFO [http-bio-7070-exec-8] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 04:31:04,029 INFO [http-bio-7070-exec-8] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/CATEGORY/6fa65444-ddb8-47eb-affb-a0d3fd55211f.dict 2016-08-15 04:31:04,032 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:31:04,033 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 246 bytes, rawScanBytesString 40 bytes 2016-08-15 04:31:04,034 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 450293d4 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:31:04,034 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 8 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 04:31:04,034 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:31:04,035 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:31:04,037 DEBUG [http-bio-7070-exec-8] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:31:04,050 INFO [pool-8-thread-13] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.07105917551882737, server physical mem left: 2.34934272E8, server swap mem left:3.787149312E9.Etc message: start latency: 6@3,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:31:04,050 INFO [pool-8-thread-14] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 2.34934272E8, server swap mem left:3.787149312E9.Etc message: start latency: 10@1,agg done@2,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:31:04,050 DEBUG [pool-8-thread-13] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 04:31:04,050 DEBUG [pool-8-thread-14] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 04:31:04,053 INFO [http-bio-7070-exec-8] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 04:31:04,054 INFO [http-bio-7070-exec-8] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 96, total scan count 5 2016-08-15 04:31:04,054 INFO [http-bio-7070-exec-8] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' group by category User: ADMIN Success: true Duration: 0.096 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [8] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:31:36,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:31:49,333 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:31:49,334 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select category, count(category) from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' group by category 2016-08-15 04:31:49,334 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select category, count(category) from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' group by category LIMIT 50000 2016-08-15 04:31:49,388 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:31:49,388 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@7d7b5c58 2016-08-15 04:31:49,389 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:31:49,389 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:31:49,389 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:31:49,429 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:31:49,430 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:31:49,430 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 04:31:49,431 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:31:49,432 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 246 bytes, rawScanBytesString 40 bytes 2016-08-15 04:31:49,432 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 524a0007 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:31:49,432 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 8 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 04:31:49,433 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:31:49,433 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:31:49,434 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:31:49,439 INFO [pool-8-thread-14] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.04539822011940971, server physical mem left: 2.28859904E8, server swap mem left:3.78822656E9.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:31:49,439 DEBUG [pool-8-thread-14] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 04:31:49,445 INFO [pool-8-thread-13] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 2.28859904E8, server swap mem left:3.78822656E9.Etc message: start latency: 4@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:31:49,445 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 04:31:49,445 DEBUG [pool-8-thread-13] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 04:31:49,446 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 112, total scan count 5 2016-08-15 04:31:49,446 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(category) from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' group by category User: ADMIN Success: true Duration: 0.112 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [8] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:32:12,578 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:32:12,578 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' 2016-08-15 04:32:12,579 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' LIMIT 50000 2016-08-15 04:32:12,610 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:32:12,611 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@46ebf041 2016-08-15 04:32:12,611 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:32:12,611 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:32:12,612 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:32:12,633 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:32:12,633 INFO [http-bio-7070-exec-5] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:32:12,635 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:32:12,635 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 04:32:12,636 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/MINUTE_START/9e9c4094-9c04-4bd5-98b9-95ae2ecba410.dict 2016-08-15 04:32:12,640 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/DEVICE/03ba2786-9178-462b-9623-08fcd645c182.dict 2016-08-15 04:32:12,645 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/CURRENCY/d0207119-7ef8-4827-aa9d-ec71f432b3b7.dict 2016-08-15 04:32:12,652 INFO [http-bio-7070-exec-5] dict.DictionaryManager:393 : DictionaryManager(1896212582) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/COUNTRY/e6cd0d60-bbff-4333-9bcb-adcd54125681.dict 2016-08-15 04:32:12,657 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:32:12,658 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 820 bytes, rawScanBytesString 49 bytes 2016-08-15 04:32:12,658 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 5db8f3b7 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:32:12,659 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 04:32:12,659 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:32:12,660 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:32:12,660 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:32:12,668 INFO [pool-8-thread-14] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0923179101173345, server physical mem left: 2.2822912E8, server swap mem left:3.788644352E9.Etc message: start latency: 1@1,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:32:12,668 INFO [pool-8-thread-13] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 2.2822912E8, server swap mem left:3.788644352E9.Etc message: start latency: 1@1,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:32:12,669 DEBUG [pool-8-thread-14] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:32:12,670 DEBUG [pool-8-thread-13] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:32:12,673 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 29, 2016-08-15 04:32:12,674 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 95, total scan count 29 2016-08-15 04:32:12,674 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' User: ADMIN Success: true Duration: 0.095 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 29 Result row count: 29 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:32:32,416 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:32:32,417 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' order by category 2016-08-15 04:32:32,417 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' order by category LIMIT 50000 2016-08-15 04:32:32,460 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:32:32,461 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@e7a3346 2016-08-15 04:32:32,461 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:32:32,462 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:32:32,463 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:32:32,493 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:32:32,493 INFO [http-bio-7070-exec-2] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:32:32,495 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:32:32,496 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:32:32,497 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 820 bytes, rawScanBytesString 49 bytes 2016-08-15 04:32:32,497 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 481b7adb for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:32:32,498 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 04:32:32,498 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:32:32,498 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:32:32,499 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:32:32,505 INFO [pool-8-thread-14] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.020182542743283197, server physical mem left: 2.25472512E8, server swap mem left:3.789074432E9.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:32:32,505 DEBUG [pool-8-thread-14] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:32:32,508 INFO [pool-8-thread-13] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 2.25472512E8, server swap mem left:3.789074432E9.Etc message: start latency: 4@1,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:32:32,508 DEBUG [pool-8-thread-13] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:32:32,510 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 29, 2016-08-15 04:32:32,511 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 94, total scan count 29 2016-08-15 04:32:32,511 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' order by category User: ADMIN Success: true Duration: 0.094 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 29 Result row count: 29 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:32:36,068 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:33:36,016 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:34:36,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:35:31,468 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:35:31,469 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' order by category 2016-08-15 04:35:31,470 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' order by category LIMIT 50000 2016-08-15 04:35:31,536 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:35:31,536 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@8dfdd21 2016-08-15 04:35:31,537 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:35:31,537 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:35:31,538 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:35:31,593 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:35:31,594 INFO [http-bio-7070-exec-3] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:35:31,595 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:35:31,596 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:35:31,599 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 820 bytes, rawScanBytesString 49 bytes 2016-08-15 04:35:31,599 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 54027b3a for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:35:31,601 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 04:35:31,602 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:35:31,603 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:35:31,605 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:35:31,620 INFO [pool-8-thread-15] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.04310197330899966, server physical mem left: 2.1598208E8, server swap mem left:3.793002496E9.Etc message: start latency: 7@1,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:35:31,620 DEBUG [pool-8-thread-15] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:35:31,624 INFO [http-bio-7070-exec-3] service.QueryService:399 : Scan count for each storageContext: 29, 2016-08-15 04:35:31,625 INFO [pool-8-thread-16] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.0, server physical mem left: 2.1598208E8, server swap mem left:3.793002496E9.Etc message: start latency: 9@1,agg done@6,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:35:31,626 DEBUG [pool-8-thread-16] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:35:31,626 INFO [http-bio-7070-exec-3] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 156, total scan count 29 2016-08-15 04:35:31,628 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 --where minute_start = timestamp'2016-08-15 03:21:00' order by category User: ADMIN Success: true Duration: 0.156 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 29 Result row count: 29 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:35:36,042 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:35:41,791 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 04:35:41,792 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 04:35:41,797 DEBUG [http-bio-7070-exec-8] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 4 segments:KYLIN_3ST7A64L6P,KYLIN_X6P15BH8BV,KYLIN_7WCZUHE9ZW,KYLIN_E0P6VMLBBS 2016-08-15 04:35:41,800 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:35:41,801 INFO [http-bio-7070-exec-8] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:35:41,803 DEBUG [http-bio-7070-exec-8] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:35:41,803 DEBUG [http-bio-7070-exec-8] service.CubeService:591 : server mode: all 2016-08-15 04:35:41,804 INFO [http-bio-7070-exec-8] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:35:41,804 DEBUG [http-bio-7070-exec-8] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:36:25,687 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:36:26,048 DEBUG [http-bio-7070-exec-10] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:36:26,198 DEBUG [http-bio-7070-exec-9] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:36:26,360 DEBUG [http-bio-7070-exec-1] service.QueryService:291 : getting table metas 2016-08-15 04:36:26,362 INFO [http-bio-7070-exec-1] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 04:36:26,363 DEBUG [http-bio-7070-exec-1] service.QueryService:309 : getting column metas 2016-08-15 04:36:26,370 DEBUG [http-bio-7070-exec-1] service.QueryService:323 : done column metas 2016-08-15 04:36:36,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:36:38,934 INFO [http-bio-7070-exec-8] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:36:38,935 INFO [http-bio-7070-exec-8] controller.QueryController:175 : The original query: select minute_start, count(*) from streaming_sales_table_60 order by category 2016-08-15 04:36:38,935 INFO [http-bio-7070-exec-8] service.QueryService:266 : The corrected query: select minute_start, count(*) from streaming_sales_table_60 order by category LIMIT 50000 2016-08-15 04:36:38,957 ERROR [http-bio-7070-exec-8] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select minute_start, count(*) from streaming_sales_table_60 order by category LIMIT 50000": From line 1, column 9 to line 1, column 20: Expression 'MINUTE_START' is not being grouped at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 1, column 9 to line 1, column 20: Expression 'MINUTE_START' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:110) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:39) at org.apache.calcite.sql.SqlIdentifier.accept(SqlIdentifier.java:307) at org.apache.calcite.sql.validate.AggregatingSelectScope.checkAggregateExpr(AggregatingSelectScope.java:231) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelectList(SqlValidatorImpl.java:3445) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2969) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Expression 'MINUTE_START' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 105 more 2016-08-15 04:36:38,959 INFO [http-bio-7070-exec-8] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*) from streaming_sales_table_60 order by category User: ADMIN Success: false Duration: 0.0 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [8] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select minute_start, count(*) from streaming_sales_table_60 order by category LIMIT 50000": From line 1, column 9 to line 1, column 20: Expression 'MINUTE_START' is not being grouped ==========================[QUERY]=============================== 2016-08-15 04:36:38,959 ERROR [http-bio-7070-exec-8] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select minute_start, count(*) from streaming_sales_table_60 order by category LIMIT 50000": From line 1, column 9 to line 1, column 20: Expression 'MINUTE_START' is not being grouped at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 04:36:46,120 INFO [http-bio-7070-exec-7] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:36:46,121 INFO [http-bio-7070-exec-7] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table_60 order by category 2016-08-15 04:36:46,121 INFO [http-bio-7070-exec-7] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table_60 order by category LIMIT 50000 2016-08-15 04:36:46,138 ERROR [http-bio-7070-exec-7] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select category, count(*) from streaming_sales_table_60 order by category LIMIT 50000": From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:110) at org.apache.calcite.sql.validate.AggChecker.visit(AggChecker.java:39) at org.apache.calcite.sql.SqlIdentifier.accept(SqlIdentifier.java:307) at org.apache.calcite.sql.validate.AggregatingSelectScope.checkAggregateExpr(AggregatingSelectScope.java:231) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelectList(SqlValidatorImpl.java:3445) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2969) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Expression 'CATEGORY' is not being grouped at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 105 more 2016-08-15 04:36:46,140 INFO [http-bio-7070-exec-7] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table_60 order by category User: ADMIN Success: false Duration: 0.0 Project: test_kylin Realization Names: [] Cuboid Ids: [] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select category, count(*) from streaming_sales_table_60 order by category LIMIT 50000": From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped ==========================[QUERY]=============================== 2016-08-15 04:36:46,140 ERROR [http-bio-7070-exec-7] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select category, count(*) from streaming_sales_table_60 order by category LIMIT 50000": From line 1, column 9 to line 1, column 16: Expression 'CATEGORY' is not being grouped at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 04:36:55,895 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:36:55,896 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select category, count(*) from streaming_sales_table_60 group by category order by category 2016-08-15 04:36:55,897 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select category, count(*) from streaming_sales_table_60 group by category order by category LIMIT 50000 2016-08-15 04:36:55,932 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:36:55,933 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@371ea5f3 2016-08-15 04:36:55,933 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:36:55,933 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:36:55,934 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:36:55,988 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:36:55,988 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:36:55,989 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:36:55,990 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 246 bytes, rawScanBytesString 40 bytes 2016-08-15 04:36:55,990 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 34f1b91 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:36:55,990 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 8 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 04:36:55,990 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:36:55,991 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:36:55,991 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:36:56,002 INFO [pool-8-thread-17] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.05223452729412475, server physical mem left: 6.17742336E8, server swap mem left:3.795939328E9.Etc message: start latency: 2@1,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:36:56,002 INFO [pool-8-thread-18] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 6.17742336E8, server swap mem left:3.795939328E9.Etc message: start latency: 3@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:36:56,003 DEBUG [pool-8-thread-17] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 1 2016-08-15 04:36:56,003 DEBUG [pool-8-thread-18] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 04:36:56,006 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 04:36:56,007 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 111, total scan count 5 2016-08-15 04:36:56,007 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(*) from streaming_sales_table_60 group by category order by category User: ADMIN Success: true Duration: 0.111 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [8] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:37:04,709 DEBUG [http-bio-7070-exec-8] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:37:04,712 DEBUG [http-bio-7070-exec-1] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:37:04,968 DEBUG [http-bio-7070-exec-1] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:37:05,276 INFO [http-bio-7070-exec-4] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:37:09,876 INFO [http-bio-7070-exec-1] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 04:37:09,877 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 04:37:12,277 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_E0P6VMLBBS". 2016-08-15 04:37:23,200 DEBUG [http-bio-7070-exec-4] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:37:23,212 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:37:23,405 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:37:23,639 INFO [http-bio-7070-exec-3] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 04:37:36,012 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:38:36,014 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:39:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:40:28,776 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:40:28,823 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:40:28,824 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 order by category 2016-08-15 04:40:28,849 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:40:28,849 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@43f03edc 2016-08-15 04:40:28,849 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:40:28,850 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:40:28,850 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:40:28,879 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:40:28,879 INFO [http-bio-7070-exec-3] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:40:28,880 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:40:28,880 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:40:28,881 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 820 bytes, rawScanBytesString 49 bytes 2016-08-15 04:40:28,881 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 21279507 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:40:28,882 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 04:40:28,882 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:40:28,882 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:40:28,883 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:40:28,891 INFO [pool-8-thread-19] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 5.96414464E8, server swap mem left:3.800113152E9.Etc message: start latency: 5@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:40:28,891 INFO [pool-8-thread-20] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.04765453168755934, server physical mem left: 5.96414464E8, server swap mem left:3.800113152E9.Etc message: start latency: 2@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:40:28,891 DEBUG [pool-8-thread-19] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:40:28,891 DEBUG [pool-8-thread-20] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 04:40:28,895 INFO [http-bio-7070-exec-3] service.QueryService:399 : Scan count for each storageContext: 29, 2016-08-15 04:40:28,896 INFO [http-bio-7070-exec-3] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 72, total scan count 29 2016-08-15 04:40:28,896 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 order by category User: ADMIN Success: true Duration: 0.072 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 29 Result row count: 29 Accept Partial: false Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:40:36,012 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:41:36,045 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:42:15,185 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:42:15,195 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 where category = 'TOY' order by category 2016-08-15 04:42:15,196 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select minute_start, category from streaming_sales_table_60 where category = 'TOY' order by category LIMIT 50000 2016-08-15 04:42:15,266 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:42:15,267 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@2edf9fb2 2016-08-15 04:42:15,267 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:42:15,267 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:42:15,268 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:42:15,304 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:42:15,305 INFO [http-bio-7070-exec-2] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:42:15,306 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:42:15,308 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:42:15,309 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 869 bytes, rawScanBytesString 87 bytes 2016-08-15 04:42:15,310 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 356b8dd8 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:42:15,311 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x04\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x04\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x04\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x04\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x04\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x00\x01\x01\x01; 2016-08-15 04:42:15,312 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:42:15,312 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:42:15,313 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:42:15,319 INFO [pool-8-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 5.86244096E8, server swap mem left:3.802996736E9.Etc message: start latency: 3@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:42:15,320 INFO [pool-8-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.04404633942434014, server physical mem left: 5.86244096E8, server swap mem left:3.802996736E9.Etc message: start latency: 3@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:42:15,320 DEBUG [pool-8-thread-21] util.CompressionUtils:67 : Original: 39 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:42:15,320 DEBUG [pool-8-thread-22] util.CompressionUtils:67 : Original: 39 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:42:15,321 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 7, 2016-08-15 04:42:15,322 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 127, total scan count 7 2016-08-15 04:42:15,322 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 where category = 'TOY' order by category User: ADMIN Success: true Duration: 0.127 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 7 Result row count: 7 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:42:24,528 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:42:24,529 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 where category = 'TOY' 2016-08-15 04:42:24,530 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select minute_start, category from streaming_sales_table_60 where category = 'TOY' LIMIT 50000 2016-08-15 04:42:24,586 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:42:24,587 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@603b24f7 2016-08-15 04:42:24,587 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:42:24,588 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:42:24,588 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:42:24,617 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:42:24,618 INFO [http-bio-7070-exec-2] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:42:24,619 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:42:24,620 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:42:24,621 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 869 bytes, rawScanBytesString 87 bytes 2016-08-15 04:42:24,621 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 1feb45cc for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:42:24,623 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x04\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x04\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x04\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x04\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x04\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x00\x01\x01\x01; 2016-08-15 04:42:24,624 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:42:24,624 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:42:24,625 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:42:24,634 INFO [pool-8-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.024024024024024024, server physical mem left: 5.8558464E8, server swap mem left:3.803234304E9.Etc message: start latency: 2@2,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:42:24,634 INFO [pool-8-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.0, server physical mem left: 5.8558464E8, server swap mem left:3.803234304E9.Etc message: start latency: 2@2,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:42:24,635 DEBUG [pool-8-thread-22] util.CompressionUtils:67 : Original: 39 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:42:24,635 DEBUG [pool-8-thread-21] util.CompressionUtils:67 : Original: 39 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:42:24,636 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 7, 2016-08-15 04:42:24,637 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 108, total scan count 7 2016-08-15 04:42:24,637 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 where category = 'TOY' User: ADMIN Success: true Duration: 0.108 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 7 Result row count: 7 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:42:36,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:42:49,388 INFO [http-bio-7070-exec-1] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:42:49,390 INFO [http-bio-7070-exec-1] controller.QueryController:175 : The original query: select minute_start, category from streaming_sales_table_60 where category = 'ELECTRONIC' 2016-08-15 04:42:49,391 INFO [http-bio-7070-exec-1] service.QueryService:266 : The corrected query: select minute_start, category from streaming_sales_table_60 where category = 'ELECTRONIC' LIMIT 50000 2016-08-15 04:42:49,435 INFO [http-bio-7070-exec-1] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:42:49,436 INFO [http-bio-7070-exec-1] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@473e8912 2016-08-15 04:42:49,436 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:42:49,437 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:42:49,437 INFO [http-bio-7070-exec-1] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:42:49,478 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:42:49,478 INFO [http-bio-7070-exec-1] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:42:49,479 INFO [http-bio-7070-exec-1] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:42:49,481 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:42:49,484 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 869 bytes, rawScanBytesString 87 bytes 2016-08-15 04:42:49,484 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 119caa95 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:42:49,485 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x02\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x02\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x02\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x02\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x02\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x00\x01\x01\x01; 2016-08-15 04:42:49,486 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:42:49,579 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:42:49,580 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:42:49,589 INFO [pool-8-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.028824607863108573, server physical mem left: 5.851136E8, server swap mem left:3.816460288E9.Etc message: start latency: 2@2,agg done@4,compress done@4,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:42:49,590 DEBUG [pool-8-thread-21] util.CompressionUtils:67 : Original: 37 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:42:49,591 INFO [http-bio-7070-exec-1] service.QueryService:399 : Scan count for each storageContext: 7, 2016-08-15 04:42:49,592 INFO [http-bio-7070-exec-1] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 201, total scan count 7 2016-08-15 04:42:49,592 INFO [http-bio-7070-exec-1] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, category from streaming_sales_table_60 where category = 'ELECTRONIC' User: ADMIN Success: true Duration: 0.201 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 7 Result row count: 7 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:42:49,595 INFO [pool-8-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 5.851136E8, server swap mem left:3.816460288E9.Etc message: start latency: 11@1,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:42:49,595 DEBUG [pool-8-thread-22] util.CompressionUtils:67 : Original: 37 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:43:02,122 INFO [http-bio-7070-exec-1] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:43:02,123 INFO [http-bio-7070-exec-1] controller.QueryController:175 : The original query: select category, count(category) from streaming_sales_table_60 group by category order by category 2016-08-15 04:43:02,123 INFO [http-bio-7070-exec-1] service.QueryService:266 : The corrected query: select category, count(category) from streaming_sales_table_60 group by category order by category LIMIT 50000 2016-08-15 04:43:02,161 INFO [http-bio-7070-exec-1] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:43:02,162 INFO [http-bio-7070-exec-1] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@b0a6587 2016-08-15 04:43:02,163 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:43:02,164 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:43:02,164 INFO [http-bio-7070-exec-1] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:43:02,209 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:43:02,210 INFO [http-bio-7070-exec-1] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:43:02,210 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:43:02,211 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 246 bytes, rawScanBytesString 40 bytes 2016-08-15 04:43:02,211 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 4a344f4e for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:43:02,212 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 8 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 04:43:02,213 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:43:02,213 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:43:02,214 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:43:02,219 INFO [pool-8-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.031092267312739754, server physical mem left: 5.83933952E8, server swap mem left:3.816812544E9.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:43:02,220 DEBUG [pool-8-thread-22] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 1 2016-08-15 04:43:02,220 INFO [pool-8-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 5.83757824E8, server swap mem left:3.816812544E9.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:43:02,220 DEBUG [pool-8-thread-21] util.CompressionUtils:67 : Original: 18 bytes. Decompressed: 10 bytes. Time: 0 2016-08-15 04:43:02,223 INFO [http-bio-7070-exec-1] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 04:43:02,224 INFO [http-bio-7070-exec-1] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 101, total scan count 5 2016-08-15 04:43:02,224 INFO [http-bio-7070-exec-1] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category, count(category) from streaming_sales_table_60 group by category order by category User: ADMIN Success: true Duration: 0.101 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [8] Total scan count: 5 Result row count: 5 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:43:12,876 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:43:12,878 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select category from streaming_sales_table_60 where category = 'ELECTRONIC' 2016-08-15 04:43:12,879 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select category from streaming_sales_table_60 where category = 'ELECTRONIC' LIMIT 50000 2016-08-15 04:43:12,918 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:43:12,919 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@4bef6288 2016-08-15 04:43:12,919 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:43:12,919 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:43:12,920 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:43:12,956 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:43:12,957 INFO [http-bio-7070-exec-10] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:43:12,957 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:43:12,959 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:43:12,961 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 869 bytes, rawScanBytesString 87 bytes 2016-08-15 04:43:12,962 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 3c2159e1 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:43:12,963 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x02\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x02\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x02\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\x02\xFF\xFF\xFF\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x02\x00\x00\x00 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01\x01\x01\x01\x00\x01\x01\x01; 2016-08-15 04:43:12,963 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:43:12,964 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:43:12,965 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:43:12,971 INFO [pool-8-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.12936150011868028, server physical mem left: 5.83954432E8, server swap mem left:3.816943616E9.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:43:12,971 INFO [pool-8-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 7. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 5.83954432E8, server swap mem left:3.816943616E9.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:43:12,972 DEBUG [pool-8-thread-22] util.CompressionUtils:67 : Original: 37 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:43:12,972 DEBUG [pool-8-thread-21] util.CompressionUtils:67 : Original: 37 bytes. Decompressed: 56 bytes. Time: 0 2016-08-15 04:43:12,973 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 7, 2016-08-15 04:43:12,974 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 95, total scan count 7 2016-08-15 04:43:12,974 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category from streaming_sales_table_60 where category = 'ELECTRONIC' User: ADMIN Success: true Duration: 0.095 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 7 Result row count: 7 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:43:36,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:43:49,518 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:43:49,522 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select count(category) from streaming_sales_table_60 where category = 'ELECTRONIC' 2016-08-15 04:43:49,522 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select count(category) from streaming_sales_table_60 where category = 'ELECTRONIC' LIMIT 50000 2016-08-15 04:43:49,566 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:43:49,567 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@6c321f1c 2016-08-15 04:43:49,568 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:43:49,569 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 04:43:49,569 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:43:49,622 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:43:49,622 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:43:49,624 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:43:49,625 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 294 bytes, rawScanBytesString 64 bytes 2016-08-15 04:43:49,625 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 452d5eb5 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:43:49,626 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 8 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x02 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x02) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x02\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x02\x00) Fuzzy key counts: 1. Fuzzy keys : \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x02 \x01\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00; 2016-08-15 04:43:49,626 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:43:49,627 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:43:49,628 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:43:49,635 INFO [pool-8-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.023892207251007085, server physical mem left: 5.81656576E8, server swap mem left:3.817783296E9.Etc message: start latency: 1@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:43:49,635 DEBUG [pool-8-thread-21] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 04:43:49,636 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 1, 2016-08-15 04:43:49,637 INFO [pool-8-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 1. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 1.0, server physical mem left: 5.81656576E8, server swap mem left:3.817783296E9.Etc message: start latency: 4@2,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:43:49,638 DEBUG [pool-8-thread-22] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 04:43:49,637 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 115, total scan count 1 2016-08-15 04:43:49,638 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select count(category) from streaming_sales_table_60 where category = 'ELECTRONIC' User: ADMIN Success: true Duration: 0.115 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [8] Total scan count: 1 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:44:36,011 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:44:51,963 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:44:52,024 DEBUG [http-bio-7070-exec-5] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 04:44:52,502 DEBUG [http-bio-7070-exec-3] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:44:52,672 INFO [http-bio-7070-exec-7] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 04:45:36,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:46:36,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:47:36,044 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:48:36,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:49:09,946 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: test_kylin 2016-08-15 04:49:09,947 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select category,qty, count(category) from streaming_sales_table_60 group by category,qty order by category 2016-08-15 04:49:09,948 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select category,qty, count(category) from streaming_sales_table_60 group by category,qty order by category LIMIT 50000 2016-08-15 04:49:09,970 ERROR [http-bio-7070-exec-3] controller.QueryController:209 : Exception when execute sql java.sql.SQLException: Error while executing SQL "select category,qty, count(category) from streaming_sales_table_60 group by category,qty order by category LIMIT 50000": From line 3, column 19 to line 3, column 21: Column 'QTY' not found in any table at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:361) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:273) at org.apache.kylin.rest.service.QueryService.query(QueryService.java:121) at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618) at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$41388f0a.query() at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 3, column 19 to line 3, column 21: Column 'QTY' not found in any table at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:715) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:703) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3932) at org.apache.calcite.sql.validate.EmptyScope.findQualifyingTableName(EmptyScope.java:108) at org.apache.calcite.sql.validate.DelegatingScope.findQualifyingTableName(DelegatingScope.java:112) at org.apache.calcite.sql.validate.ListScope.findQualifyingTableName(ListScope.java:150) at org.apache.calcite.sql.validate.DelegatingScope.fullyQualify(DelegatingScope.java:154) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateIdentifier(SqlValidatorImpl.java:2592) at org.apache.calcite.sql.SqlIdentifier.validateExpr(SqlIdentifier.java:287) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateGroupClause(SqlValidatorImpl.java:3308) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2962) at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:848) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:834) at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:207) at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:808) at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:522) at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:584) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:226) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:721) at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:588) at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:558) at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:214) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:573) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135) ... 79 more Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Column 'QTY' not found in any table at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:405) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:514) ... 107 more 2016-08-15 04:49:09,973 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select category,qty, count(category) from streaming_sales_table_60 group by category,qty order by category User: ADMIN Success: false Duration: 0.0 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: Error while executing SQL "select category,qty, count(category) from streaming_sales_table_60 group by category,qty order by category LIMIT 50000": From line 3, column 19 to line 3, column 21: Column 'QTY' not found in any table ==========================[QUERY]=============================== 2016-08-15 04:49:09,973 ERROR [http-bio-7070-exec-3] controller.BasicController:44 : org.apache.kylin.rest.exception.InternalErrorException: Error while executing SQL "select category,qty, count(category) from streaming_sales_table_60 group by category,qty order by category LIMIT 50000": From line 3, column 19 to line 3, column 21: Column 'QTY' not found in any table at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224) at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94) at sun.reflect.GeneratedMethodAccessor122.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) at javax.servlet.http.HttpServlet.service(HttpServlet.java:646) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 04:49:36,008 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:50:36,046 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:51:22,461 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:51:22,722 DEBUG [http-bio-7070-exec-7] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 04:51:22,723 INFO [http-bio-7070-exec-7] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 04:51:22,724 DEBUG [http-bio-7070-exec-7] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 04:51:22,740 DEBUG [http-bio-7070-exec-7] service.QueryService:291 : getting table metas 2016-08-15 04:51:22,741 DEBUG [http-bio-7070-exec-7] service.QueryService:309 : getting column metas 2016-08-15 04:51:22,747 DEBUG [http-bio-7070-exec-7] service.QueryService:323 : done column metas 2016-08-15 04:51:24,499 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:51:34,922 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:51:34,981 DEBUG [http-bio-7070-exec-10] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-08-15 04:51:36,165 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:51:38,750 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:51:38,786 DEBUG [http-bio-7070-exec-6] service.QueryService:291 : getting table metas 2016-08-15 04:51:38,787 DEBUG [http-bio-7070-exec-6] service.QueryService:309 : getting column metas 2016-08-15 04:51:38,796 DEBUG [http-bio-7070-exec-6] service.QueryService:323 : done column metas 2016-08-15 04:51:59,624 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 04:51:59,626 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select * from STREAMING_SALES_TABLE 2016-08-15 04:51:59,626 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select * from STREAMING_SALES_TABLE LIMIT 50000 2016-08-15 04:51:59,662 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@3fae97d4 2016-08-15 04:51:59,662 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@7a8c8268 2016-08-15 04:51:59,662 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 04:51:59,663 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 04:51:59,663 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 04:51:59,671 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 04:51:59,671 INFO [http-bio-7070-exec-2] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 04:51:59,672 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 04:51:59,673 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 04:51:59,674 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815032000_20160815032500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:51:59,675 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1137 bytes, rawScanBytesString 68 bytes 2016-08-15 04:51:59,675 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 593f11a7 for segment Streaming_Cube[20160815032000_20160815032500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:51:59,677 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_3ST7A64L6P: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 04:51:59,677 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:51:59,677 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:51:59,678 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:116 : Skip cube segment Streaming_Cube[20160815034500_20160815034530] because its input record is 0 2016-08-15 04:51:59,678 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:116 : Skip cube segment Streaming_Cube[20160815040000_20160815040500] because its input record is 0 2016-08-15 04:51:59,679 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815042500_20160815043000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 04:51:59,681 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1137 bytes, rawScanBytesString 68 bytes 2016-08-15 04:51:59,681 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 3dd690d8 for segment Streaming_Cube[20160815042500_20160815043000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 04:51:59,682 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_E0P6VMLBBS: cuboid exact match, from 127 to 127 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 04:51:59,682 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 04:51:59,682 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 04:51:59,683 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 04:51:59,713 INFO [pool-8-thread-26] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_E0P6VMLBBS Shard \x4B\x59\x4C\x49\x4E\x5F\x45\x30\x50\x36\x56\x4D\x4C\x42\x42\x53\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x37\x32\x39\x38\x39\x34\x2E\x30\x61\x62\x30\x63\x64\x31\x30\x32\x33\x64\x34\x63\x38\x35\x65\x36\x66\x31\x39\x37\x39\x65\x30\x36\x64\x66\x62\x36\x37\x34\x36\x2E on host: sandbox.hortonworks.com.Total scanned row: 140. Total filtered/aggred row: 0. Time elapsed in EP: 16(ms). Server CPU usage: 0.045410980310449, server physical mem left: 5.29977344E8, server swap mem left:3.835846656E9.Etc message: start latency: 9@2,agg done@16,compress done@16,server stats done@16, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:51:59,714 DEBUG [pool-8-thread-26] util.CompressionUtils:67 : Original: 1190 bytes. Decompressed: 2935 bytes. Time: 0 2016-08-15 04:51:59,718 INFO [pool-8-thread-25] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_E0P6VMLBBS Shard \x4B\x59\x4C\x49\x4E\x5F\x45\x30\x50\x36\x56\x4D\x4C\x42\x42\x53\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x37\x32\x39\x38\x39\x34\x2E\x30\x61\x62\x30\x63\x64\x31\x30\x32\x33\x64\x34\x63\x38\x35\x65\x36\x66\x31\x39\x37\x39\x65\x30\x36\x64\x66\x62\x36\x37\x34\x36\x2E on host: sandbox.hortonworks.com.Total scanned row: 140. Total filtered/aggred row: 0. Time elapsed in EP: 25(ms). Server CPU usage: 0.75, server physical mem left: 5.29977344E8, server swap mem left:3.835846656E9.Etc message: start latency: 9@2,agg done@25,compress done@25,server stats done@25, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:51:59,719 DEBUG [pool-8-thread-25] util.CompressionUtils:67 : Original: 1190 bytes. Decompressed: 2935 bytes. Time: 0 2016-08-15 04:51:59,719 INFO [pool-8-thread-24] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 36(ms). Server CPU usage: 0.0, server physical mem left: 5.29977344E8, server swap mem left:3.835846656E9.Etc message: start latency: 4@1,agg done@35,compress done@35,server stats done@36, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:51:59,721 DEBUG [pool-8-thread-24] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 0 2016-08-15 04:51:59,723 INFO [pool-8-thread-23] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_3ST7A64L6P Shard \x4B\x59\x4C\x49\x4E\x5F\x33\x53\x54\x37\x41\x36\x34\x4C\x36\x50\x2C\x2C\x31\x34\x37\x31\x32\x33\x31\x38\x31\x33\x36\x33\x31\x2E\x65\x34\x30\x66\x38\x37\x30\x34\x65\x61\x62\x66\x33\x34\x33\x31\x33\x37\x66\x38\x64\x66\x36\x35\x63\x63\x35\x34\x61\x64\x36\x65\x2E on host: sandbox.hortonworks.com.Total scanned row: 138. Total filtered/aggred row: 0. Time elapsed in EP: 40(ms). Server CPU usage: 1.0, server physical mem left: 5.29977344E8, server swap mem left:3.835846656E9.Etc message: start latency: 2@1,agg done@40,compress done@40,server stats done@40, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 04:51:59,725 DEBUG [pool-8-thread-23] util.CompressionUtils:67 : Original: 1160 bytes. Decompressed: 2896 bytes. Time: 0 2016-08-15 04:51:59,771 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 278, 2016-08-15 04:51:59,772 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 146, total scan count 278 2016-08-15 04:51:59,772 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from STREAMING_SALES_TABLE User: ADMIN Success: true Duration: 0.146 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [127] Total scan count: 278 Result row count: 278 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 04:52:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:53:36,014 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:54:36,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:55:36,011 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:56:36,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:57:36,053 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:58:36,035 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:58:47,842 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:58:52,048 INFO [http-bio-7070-exec-10] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 04:58:52,054 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471235741532, to newTs: 1471237132048, operation result: true 2016-08-15 04:58:52,055 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 04:58:52,058 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 4 segments:KYLIN_3ST7A64L6P,KYLIN_X6P15BH8BV,KYLIN_7WCZUHE9ZW,KYLIN_E0P6VMLBBS 2016-08-15 04:58:52,059 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 04:58:52,059 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 04:58:52,064 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:58:52,064 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:58:52,064 DEBUG [http-bio-7070-exec-8] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 4 segments:KYLIN_3ST7A64L6P,KYLIN_X6P15BH8BV,KYLIN_7WCZUHE9ZW,KYLIN_E0P6VMLBBS 2016-08-15 04:58:52,065 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:58:52,065 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 04:58:52,067 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:58:52,068 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:58:52,068 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:58:52,068 INFO [http-bio-7070-exec-8] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:58:52,069 DEBUG [http-bio-7070-exec-8] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:58:52,069 DEBUG [http-bio-7070-exec-8] service.CubeService:591 : server mode: all 2016-08-15 04:58:52,069 INFO [http-bio-7070-exec-8] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:58:52,069 DEBUG [http-bio-7070-exec-8] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:58:56,036 INFO [http-bio-7070-exec-4] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 04:58:56,040 DEBUG [http-bio-7070-exec-4] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471237132048, to newTs: 1471237136036, operation result: true 2016-08-15 04:58:56,041 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/17216afd-b9df-4f39-b314-ea5caaf9b37d.seq (Store kylin_metadata@hbase) 2016-08-15 04:58:56,047 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/6053164c-e65f-4398-9153-0fdffca9b438.seq (Store kylin_metadata@hbase) 2016-08-15 04:58:56,050 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/7e7ec477-6e93-441b-9392-644ab3ce47b8.seq (Store kylin_metadata@hbase) 2016-08-15 04:58:56,053 DEBUG [http-bio-7070-exec-4] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/f3c831a1-17ba-40ba-a5da-96f7859d21ba.seq (Store kylin_metadata@hbase) 2016-08-15 04:58:56,056 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 04:58:56,059 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 0 segments: 2016-08-15 04:58:56,065 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:58:56,065 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:58:56,065 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:58:56,066 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 04:58:56,067 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:58:56,065 INFO [http-bio-7070-exec-10] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 04:58:56,067 DEBUG [http-bio-7070-exec-4] cube.CubeManager:639 : Cube Streaming_Cube has no ready segment to merge 2016-08-15 04:58:56,068 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:58:56,067 INFO [http-bio-7070-exec-10] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 04:58:56,073 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 0 segments: 2016-08-15 04:58:56,082 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 04:58:56,083 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 04:58:56,083 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 04:58:56,083 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 04:58:56,083 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 04:58:56,084 DEBUG [http-bio-7070-exec-10] cube.CubeManager:639 : Cube Streaming_Cube has no ready segment to merge 2016-08-15 04:58:56,084 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 04:59:03,463 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:04,047 DEBUG [http-bio-7070-exec-4] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:04,126 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:05,284 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:36,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 04:59:36,287 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:38,296 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:40,961 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:47,218 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:48,452 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 04:59:50,798 DEBUG [http-bio-7070-exec-7] controller.CubeController:558 : Saving cube { "uuid": "0d411491-f700-4767-90b0-3d7fb277ab2c", "version": "1.5.2", "name": "Streaming_Cube", "description": "", "dimensions": [ { "name": "DEFAULT.STREAMING_SALES_TABLE.CATEGORY", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "CATEGORY", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.CURRENCY", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "CURRENCY", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.COUNTRY", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "COUNTRY", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.MINUTE_START", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "MINUTE_START", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.DEVICE", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "DEVICE", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.DAY_START", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "DAY_START", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.HOUR_START", "table": "DEFAULT.STREAMING_SALES_TABLE", "column": "HOUR_START", "derived": null }, { "name": "DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME", "table": "DEFAULT.STREAMING_SALES_TABLE", "derived": null, "column": "ORDER_TIME" } ], "measures": [ { "name": "_COUNT_", "function": { "expression": "COUNT", "parameter": { "type": "constant", "value": "1", "next_parameter": null }, "returntype": "bigint" }, "dependent_measure_ref": null }, { "name": "TOTAL_AMT", "function": { "expression": "SUM", "parameter": { "type": "column", "value": "AMOUNT", "next_parameter": null }, "returntype": "decimal(19,4)" }, "dependent_measure_ref": null }, { "name": "TOTAL_QTY", "function": { "expression": "SUM", "parameter": { "type": "column", "value": "QTY", "next_parameter": null }, "returntype": "bigint" }, "dependent_measure_ref": null } ], "rowkey": { "rowkey_columns": [ { "column": "MINUTE_START", "encoding": "dict", "isShardBy": false }, { "column": "CATEGORY", "encoding": "dict", "isShardBy": false }, { "column": "CURRENCY", "encoding": "dict", "isShardBy": false }, { "column": "COUNTRY", "encoding": "dict", "isShardBy": false }, { "column": "DEVICE", "encoding": "dict", "isShardBy": false }, { "column": "DAY_START", "encoding": "dict", "isShardBy": false }, { "column": "HOUR_START", "encoding": "dict", "isShardBy": false }, { "column": "ORDER_TIME", "encoding": "dict", "isShardBy": "false" } ] }, "signature": "S5Ds5xd7i5cl9MqRKNTW8A==", "last_modified": 1470968796750, "model_name": "Streaming_Model", "null_string": null, "hbase_mapping": { "column_family": [ { "name": "f1", "columns": [ { "qualifier": "m", "measure_refs": [ "_COUNT_", "TOTAL_AMT", "TOTAL_QTY" ] } ] } ] }, "aggregation_groups": [ { "includes": [ "CATEGORY", "CURRENCY", "COUNTRY", "MINUTE_START", "DEVICE" ], "select_rule": { "hierarchy_dims": [], "mandatory_dims": [], "joint_dims": [] } } ], "notify_list": [], "status_need_notify": [ "ERROR", "DISCARDED", "SUCCEED" ], "partition_date_start": 0, "partition_date_end": 3153600000000, "auto_merge_time_ranges": [ 1800000, 14400000, 86400000, 604800000, 2419200000 ], "retention_range": 2592000000, "engine_type": 2, "storage_type": 2, "override_kylin_properties": {}, "project": "Kafka_Streaming" } 2016-08-15 04:59:50,857 DEBUG [http-bio-7070-exec-7] hbase.HBaseResourceStore:262 : Update row /cube_desc/Streaming_Cube.json from oldTs: 1470968796750, to newTs: 1471237190852, operation result: true 2016-08-15 04:59:50,860 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube_desc, name=Streaming_Cube, action=update} 2016-08-15 04:59:50,861 INFO [http-bio-7070-exec-7] service.CubeService:253 : Updated cube Streaming_Cube has 32 cuboids 2016-08-15 04:59:50,866 INFO [http-bio-7070-exec-6] controller.CacheController:64 : wipe cache type: CUBE_DESC event:UPDATE name:Streaming_Cube 2016-08-15 04:59:50,866 INFO [http-bio-7070-exec-6] service.CacheService:171 : rebuild cache type: CUBE_DESC name:Streaming_Cube 2016-08-15 04:59:51,126 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:00:36,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:01:36,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:02:36,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:03:36,008 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:04:36,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:05:15,075 INFO [http-bio-7070-exec-7] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 05:05:15,077 INFO [http-bio-7070-exec-7] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 05:05:15,086 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 1 segments:KYLIN_O71JLBZAOY 2016-08-15 05:05:15,095 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 05:05:15,096 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 05:05:15,096 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 05:05:15,097 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 05:05:15,097 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 05:05:15,098 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 05:05:31,416 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:05:36,038 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:06:36,051 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:07:36,096 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:08:36,010 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:09:36,088 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:10:24,529 INFO [http-bio-7070-exec-3] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 05:10:24,529 INFO [http-bio-7070-exec-3] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 05:10:24,537 DEBUG [http-bio-7070-exec-3] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 2 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6 2016-08-15 05:10:24,542 INFO [http-bio-7070-exec-3] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 05:10:24,542 INFO [http-bio-7070-exec-3] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 05:10:24,543 DEBUG [http-bio-7070-exec-3] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 05:10:24,543 DEBUG [http-bio-7070-exec-3] service.CubeService:591 : server mode: all 2016-08-15 05:10:24,544 INFO [http-bio-7070-exec-3] service.CubeService:600 : checking keepCubeRetention 2016-08-15 05:10:24,544 DEBUG [http-bio-7070-exec-3] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 05:10:36,240 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:11:36,146 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:11:46,086 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:11:46,106 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:11:46,109 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:11:46,139 DEBUG [http-bio-7070-exec-6] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 05:11:47,576 DEBUG [http-bio-7070-exec-9] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:11:47,734 DEBUG [http-bio-7070-exec-3] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:11:47,752 DEBUG [http-bio-7070-exec-3] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:11:48,110 INFO [http-bio-7070-exec-9] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 05:11:48,111 INFO [http-bio-7070-exec-9] controller.TableController:95 : Return all table metadata in 2 seconds 2016-08-15 05:11:52,232 INFO [http-bio-7070-exec-6] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_O71JLBZAOY". 2016-08-15 05:11:52,284 INFO [http-bio-7070-exec-6] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_RYLCSKWFA6". 2016-08-15 05:12:36,085 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:13:36,089 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:14:36,099 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:14:45,714 DEBUG [http-bio-7070-exec-1] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 05:14:45,733 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:14:46,057 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:14:46,315 INFO [http-bio-7070-exec-5] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 05:14:57,801 INFO [http-bio-7070-exec-2] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 05:14:57,812 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471237823936, to newTs: 1471238097801, operation result: true 2016-08-15 05:14:57,813 INFO [pool-6-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 05:14:57,818 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 2 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6 2016-08-15 05:14:57,825 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 05:14:57,826 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 05:14:57,826 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 05:14:57,827 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 05:14:57,827 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 05:14:57,827 INFO [http-bio-7070-exec-7] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 05:14:57,828 INFO [http-bio-7070-exec-7] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 05:14:57,828 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 05:14:57,843 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 2 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6 2016-08-15 05:14:57,848 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 05:14:57,849 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 05:14:57,850 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 05:14:57,850 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 05:14:57,850 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 05:14:57,851 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 05:15:36,186 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:16:36,111 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:17:25,343 DEBUG [http-bio-7070-exec-1] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 05:17:25,355 DEBUG [http-bio-7070-exec-10] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:17:25,653 DEBUG [http-bio-7070-exec-1] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:17:25,886 INFO [http-bio-7070-exec-8] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 05:17:25,887 INFO [http-bio-7070-exec-8] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 05:17:36,139 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:18:36,186 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:19:36,125 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:20:26,347 INFO [http-bio-7070-exec-5] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 05:20:26,349 INFO [http-bio-7070-exec-5] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 05:20:26,354 DEBUG [http-bio-7070-exec-5] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 4 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ 2016-08-15 05:20:26,361 INFO [http-bio-7070-exec-5] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 05:20:26,362 INFO [http-bio-7070-exec-5] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 05:20:26,362 DEBUG [http-bio-7070-exec-5] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 05:20:26,362 DEBUG [http-bio-7070-exec-5] service.CubeService:591 : server mode: all 2016-08-15 05:20:26,363 INFO [http-bio-7070-exec-5] service.CubeService:600 : checking keepCubeRetention 2016-08-15 05:20:26,364 DEBUG [http-bio-7070-exec-5] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 05:20:36,368 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:21:36,104 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:22:36,177 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:23:14,018 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:23:14,097 DEBUG [http-bio-7070-exec-5] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 05:23:15,266 DEBUG [http-bio-7070-exec-10] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:23:15,548 INFO [http-bio-7070-exec-2] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 05:23:15,549 INFO [http-bio-7070-exec-2] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 05:23:18,434 INFO [http-bio-7070-exec-1] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_QI5RHA2QG8". 2016-08-15 05:23:18,479 INFO [http-bio-7070-exec-1] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_6KDY71AMVZ". 2016-08-15 05:23:36,136 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:24:36,099 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:25:22,783 INFO [http-bio-7070-exec-7] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 05:25:22,784 INFO [http-bio-7070-exec-7] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 05:25:22,796 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 5 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM 2016-08-15 05:25:22,799 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 05:25:22,800 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 05:25:22,801 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 05:25:22,801 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 05:25:22,801 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 05:25:22,810 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 05:25:36,251 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 05:25:47,553 DEBUG [http-bio-7070-exec-10] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 05:25:47,555 DEBUG [http-bio-7070-exec-3] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:25:47,996 DEBUG [http-bio-7070-exec-10] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 05:25:48,325 INFO [http-bio-7070-exec-3] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 05:25:48,326 INFO [http-bio-7070-exec-3] controller.TableController:95 : Return all table metadata in 1 seconds 2016-08-15 05:25:51,385 INFO [http-bio-7070-exec-1] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_RQBYOKVTHM". 2016-08-15 05:26:11,123 DEBUG [Thread-12] threadpool.DefaultScheduler:182 : Closing zk connection 2016-08-15 06:39:11,370 INFO [localhost-startStop-1] core.SpringSecurityCoreVersion:33 : You are running with Spring Security Core 3.1.2.RELEASE 2016-08-15 06:39:11,374 INFO [localhost-startStop-1] config.SecurityNamespaceHandler:59 : Spring Security 'config' module version is 3.1.2.RELEASE 2016-08-15 06:39:11,393 INFO [localhost-startStop-1] method.GlobalMethodSecurityBeanDefinitionParser:141 : Using bean 'expressionHandler' as method ExpressionHandler implementation 2016-08-15 06:39:11,455 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/user/authentication*/** 2016-08-15 06:39:11,455 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/query*/** 2016-08-15 06:39:11,455 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/metadata*/** 2016-08-15 06:39:11,455 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/**/metrics 2016-08-15 06:39:11,456 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/cache*/** 2016-08-15 06:39:11,456 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasAnyRole('ROLE_ANALYST')' for /api/cubes/src/tables 2016-08-15 06:39:11,456 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/cubes*/** 2016-08-15 06:39:11,456 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/models*/** 2016-08-15 06:39:11,456 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/streaming*/** 2016-08-15 06:39:11,457 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/job*/** 2016-08-15 06:39:11,457 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/admin/config 2016-08-15 06:39:11,457 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'permitAll' for /api/projects 2016-08-15 06:39:11,457 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'hasRole('ROLE_ADMIN')' for /api/admin*/** 2016-08-15 06:39:11,458 INFO [localhost-startStop-1] http.FilterInvocationSecurityMetadataSourceParser:134 : Creating access control expression attribute 'isAuthenticated()' for /api/** 2016-08-15 06:39:11,479 INFO [localhost-startStop-1] http.AuthenticationConfigBuilder:465 : No login page configured. The default internal one will be used. Use the 'login-page' attribute to set the URL of the login page. 2016-08-15 06:39:11,484 INFO [localhost-startStop-1] http.HttpSecurityBeanDefinitionParser:264 : Checking sorted filter chain: [Root bean: class [org.springframework.security.web.context.SecurityContextPersistenceFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 300, Root bean: class [org.springframework.security.web.authentication.logout.LogoutFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 400, , order = 800, Root bean: class [org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1000, Root bean: class [org.springframework.security.web.authentication.www.BasicAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1200, Root bean: class [org.springframework.security.web.savedrequest.RequestCacheAwareFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1300, Root bean: class [org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1400, Root bean: class [org.springframework.security.web.authentication.AnonymousAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1700, Root bean: class [org.springframework.security.web.session.SessionManagementFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1800, Root bean: class [org.springframework.security.web.access.ExceptionTranslationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1900, , order = 2000] 2016-08-15 06:39:12,105 WARN [localhost-startStop-1] common.KylinConfig:163 : KYLIN_CONF property was not set, will seek KYLIN_HOME env variable 2016-08-15 06:39:12,168 INFO [localhost-startStop-1] security.PasswordPlaceholderConfigurer:177 : Loading properties file from resource loaded through InputStream 2016-08-15 06:39:12,857 INFO [localhost-startStop-1] util.Version:27 : HV000001: Hibernate Validator 5.1.3.Final 2016-08-15 06:39:13,697 INFO [localhost-startStop-1] init.InitialTaskManager:36 : Kylin service is starting..... 2016-08-15 06:39:14,546 INFO [localhost-startStop-1] controller.JobController:83 : Initializing Job Engine .... 2016-08-15 06:39:14,562 INFO [Thread-4] manager.ExecutableManager:73 : Using metadata url: kylin_metadata@hbase 2016-08-15 06:39:14,574 INFO [Thread-4] dao.ExecutableDao:65 : Using metadata url: kylin_metadata@hbase 2016-08-15 06:39:14,587 INFO [Thread-4] persistence.ResourceStore:82 : Using metadata url kylin_metadata@hbase for resource store 2016-08-15 06:39:14,717 INFO [localhost-startStop-1] filter.AnnotationSizeOfFilter:53 : Using regular expression provided through VM argument net.sf.ehcache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$ 2016-08-15 06:39:14,730 INFO [localhost-startStop-1] sizeof.JvmInformation:545 : Detected JVM data model settings of: Unrecognized 64-Bit JVM 2016-08-15 06:39:14,850 INFO [Thread-4] hbase.HBaseConnection:142 : connection is null or closed, creating a new one 2016-08-15 06:39:15,000 INFO [localhost-startStop-1] sizeof.AgentLoader:197 : Extracted agent jar to temporary file bin/../tomcat/temp/ehcache-sizeof-agent2957272602486262402.jar 2016-08-15 06:39:15,000 INFO [localhost-startStop-1] sizeof.AgentLoader:137 : Trying to load agent @ bin/../tomcat/temp/ehcache-sizeof-agent2957272602486262402.jar 2016-08-15 06:39:15,013 INFO [localhost-startStop-1] impl.DefaultSizeOfEngine:113 : using Agent sizeof engine 2016-08-15 06:39:15,296 INFO [localhost-startStop-1] cube.CubeManager:122 : Initializing CubeManager with config kylin_metadata@hbase 2016-08-15 06:39:16,626 DEBUG [Thread-4] hbase.HBaseConnection:188 : HTable 'kylin_metadata' already exists 2016-08-15 06:39:16,627 DEBUG [Thread-4] metadata.MetadataManager:311 : Reloading SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase 2016-08-15 06:39:16,759 DEBUG [localhost-startStop-1] cube.CubeManager:817 : Loading Cube from folder kylin_metadata(key='/cube')@kylin_metadata@hbase 2016-08-15 06:39:16,910 INFO [localhost-startStop-1] cube.CubeDescManager:91 : Initializing CubeDescManager with config kylin_metadata@hbase 2016-08-15 06:39:16,911 INFO [localhost-startStop-1] cube.CubeDescManager:197 : Reloading Cube Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase 2016-08-15 06:39:17,037 DEBUG [Thread-4] metadata.MetadataManager:320 : Loaded 17 SourceTable(s) 2016-08-15 06:39:17,037 DEBUG [Thread-4] metadata.MetadataManager:252 : Reloading SourceTable exd info from folder kylin_metadata(key='/table_exd')@kylin_metadata@hbase 2016-08-15 06:39:17,235 DEBUG [Thread-4] metadata.MetadataManager:261 : Loaded 14 SourceTable EXD(s) 2016-08-15 06:39:17,235 DEBUG [Thread-4] metadata.MetadataManager:427 : Reloading DataModel from folder kylin_metadata(key='/model_desc')@kylin_metadata@hbase 2016-08-15 06:39:17,342 DEBUG [Thread-4] metadata.MetadataManager:441 : Loaded 6 DataModel(s) 2016-08-15 06:39:17,343 DEBUG [Thread-4] metadata.MetadataManager:297 : Reloading ExternalFilter from folder kylin_metadata(key='/ext_filter')@kylin_metadata@hbase 2016-08-15 06:39:17,350 DEBUG [Thread-4] metadata.MetadataManager:306 : Loaded 0 SourceTable(s) 2016-08-15 06:39:17,397 DEBUG [localhost-startStop-1] cube.CubeDescManager:222 : Loaded 6 Cube(s) 2016-08-15 06:39:17,408 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Product_Cube with reference beingCUBE[name=Product_Cube] having 0 segments: 2016-08-15 06:39:17,413 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Product_Cube_1 with reference beingCUBE[name=Product_Cube_1] having 0 segments: 2016-08-15 06:39:17,422 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Product_Cube_2 with reference beingCUBE[name=Product_Cube_2] having 1 segments:KYLIN_OOYQPKPUSV 2016-08-15 06:39:17,428 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 5 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM 2016-08-15 06:39:17,432 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: Test_Cube with reference beingCUBE[name=Test_Cube] having 1 segments:KYLIN_KJLIL0DRNL 2016-08-15 06:39:17,436 DEBUG [localhost-startStop-1] cube.CubeManager:852 : Reloaded new cube: kylin_sales_cube with reference beingCUBE[name=kylin_sales_cube] having 0 segments: 2016-08-15 06:39:17,436 DEBUG [localhost-startStop-1] cube.CubeManager:823 : Loaded 6 Cube(s) 2016-08-15 06:39:17,576 INFO [localhost-startStop-1] badquery.BadQueryHistoryManager:42 : Initializing BadQueryHistoryManager with config kylin_metadata@hbase 2016-08-15 06:39:18,670 INFO [localhost-startStop-1] web.DefaultSecurityFilterChain:28 : Creating filter chain: org.springframework.security.web.util.AnyRequestMatcher@1, [org.springframework.security.web.context.SecurityContextPersistenceFilter@c3ccf4, org.springframework.security.web.authentication.logout.LogoutFilter@36c4a790, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@28d4fb07, org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter@36ac9d82, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@7e98ddd8, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@660cd0d6, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@5362c5f1, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@79b17bfb, org.springframework.security.web.session.SessionManagementFilter@7342da27, org.springframework.security.web.access.ExceptionTranslationFilter@2a00718f, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@31f78d4] 2016-08-15 06:39:19,473 DEBUG [http-bio-7070-exec-4] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 06:39:19,556 DEBUG [http-bio-7070-exec-6] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:39:20,095 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:39:20,156 INFO [http-bio-7070-exec-4] project.ProjectManager:88 : Initializing ProjectManager with metadata url kylin_metadata@hbase 2016-08-15 06:39:20,204 DEBUG [http-bio-7070-exec-4] project.ProjectManager:104 : Loading Project from folder kylin_metadata(key='/project')@kylin_metadata@hbase 2016-08-15 06:39:20,226 DEBUG [http-bio-7070-exec-4] project.ProjectManager:109 : Loaded 5 Project(s) 2016-08-15 06:39:20,226 DEBUG [http-bio-7070-exec-4] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:39:27,638 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_O71JLBZAOY". 2016-08-15 06:39:27,761 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_RYLCSKWFA6". 2016-08-15 06:39:27,792 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_QI5RHA2QG8". 2016-08-15 06:39:27,829 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_6KDY71AMVZ". 2016-08-15 06:39:27,882 INFO [http-bio-7070-exec-8] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_RQBYOKVTHM". 2016-08-15 06:39:28,284 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:39:34,891 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:39:37,200 DEBUG [http-bio-7070-exec-4] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 06:39:37,203 INFO [http-bio-7070-exec-4] project.ProjectL2Cache:173 : Loading L2 project cache for TEST_KYLIN 2016-08-15 06:39:37,204 INFO [http-bio-7070-exec-4] realization.RealizationRegistry:75 : Initializing RealizationRegistry with metadata url kylin_metadata@hbase 2016-08-15 06:39:37,793 INFO [http-bio-7070-exec-4] reflections.Reflections:224 : Reflections took 568 ms to scan 18 urls, producing 278 keys and 2186 values 2016-08-15 06:39:37,797 INFO [http-bio-7070-exec-4] hybrid.HybridManager:82 : Initializing HybridManager with config kylin_metadata@hbase 2016-08-15 06:39:37,806 DEBUG [http-bio-7070-exec-4] hybrid.HybridManager:92 : Loading Hybrid from folder kylin_metadata(key='/hybrid')@kylin_metadata@hbase 2016-08-15 06:39:37,807 DEBUG [http-bio-7070-exec-4] hybrid.HybridManager:98 : Loaded 0 Hybrid(s) 2016-08-15 06:39:37,813 INFO [http-bio-7070-exec-4] invertedindex.IIManager:101 : Initializing IIManager with config kylin_metadata@hbase 2016-08-15 06:39:37,822 DEBUG [http-bio-7070-exec-4] invertedindex.IIManager:226 : Loading II from folder kylin_metadata(key='/invertedindex')@kylin_metadata@hbase 2016-08-15 06:39:37,822 DEBUG [http-bio-7070-exec-4] invertedindex.IIManager:232 : Loaded 0 II(s) 2016-08-15 06:39:37,823 INFO [http-bio-7070-exec-4] realization.RealizationRegistry:103 : RealizationRegistry is {HYBRID=org.apache.kylin.storage.hybrid.HybridManager@29f17430, CUBE=org.apache.kylin.cube.CubeManager@5645a2b4, INVERTED_INDEX=org.apache.kylin.invertedindex.IIManager@75bd03ab} 2016-08-15 06:39:37,832 INFO [http-bio-7070-exec-4] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "TEST_KYLIN" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 06:39:37,834 DEBUG [http-bio-7070-exec-4] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "TEST_KYLIN" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 06:39:38,322 DEBUG [http-bio-7070-exec-4] service.QueryService:291 : getting table metas 2016-08-15 06:39:38,405 DEBUG [http-bio-7070-exec-4] service.QueryService:309 : getting column metas 2016-08-15 06:39:38,488 DEBUG [http-bio-7070-exec-4] service.QueryService:323 : done column metas 2016-08-15 06:40:02,215 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: test_kylin 2016-08-15 06:40:02,217 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select * from streaming_sales_table_60 2016-08-15 06:40:02,226 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select * from streaming_sales_table_60 LIMIT 50000 2016-08-15 06:40:03,298 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:40:03,301 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE_60 and project=TEST_KYLIN : org.apache.kylin.query.routing.Candidate@67a927eb 2016-08-15 06:40:03,308 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 06:40:03,310 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Test_Cube(CUBE)], realizations after: [Test_Cube(CUBE)] 2016-08-15 06:40:03,311 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Test_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:40:03,653 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:40:03,677 INFO [http-bio-7070-exec-2] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 06:40:03,691 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:40:03,692 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 06:40:03,718 INFO [http-bio-7070-exec-2] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/MINUTE_START/9e9c4094-9c04-4bd5-98b9-95ae2ecba410.dict 2016-08-15 06:40:03,736 INFO [http-bio-7070-exec-2] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/CATEGORY/6fa65444-ddb8-47eb-affb-a0d3fd55211f.dict 2016-08-15 06:40:03,746 INFO [http-bio-7070-exec-2] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/DEVICE/03ba2786-9178-462b-9623-08fcd645c182.dict 2016-08-15 06:40:03,749 INFO [http-bio-7070-exec-2] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/CURRENCY/d0207119-7ef8-4827-aa9d-ec71f432b3b7.dict 2016-08-15 06:40:03,753 INFO [http-bio-7070-exec-2] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE_60/COUNTRY/e6cd0d60-bbff-4333-9bcb-adcd54125681.dict 2016-08-15 06:40:03,779 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Test_Cube[20160815042200_20160815042300] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:40:03,798 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 820 bytes, rawScanBytesString 49 bytes 2016-08-15 06:40:03,799 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 1805b8e2 for segment Test_Cube[20160815042200_20160815042300] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:40:03,801 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_KJLIL0DRNL: cuboid exact match, from 31 to 31 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x1F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:40:03,801 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:40:04,237 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:40:04,349 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:40:04,641 INFO [pool-6-thread-2] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 133(ms). Server CPU usage: 0.0, server physical mem left: 1.27258624E8, server swap mem left:5.144018944E9.Etc message: start latency: 154@91,agg done@129,compress done@131,server stats done@132, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:04,642 DEBUG [pool-6-thread-2] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 06:40:04,637 INFO [pool-6-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_KJLIL0DRNL Shard \x4B\x59\x4C\x49\x4E\x5F\x4B\x4A\x4C\x49\x4C\x30\x44\x52\x4E\x4C\x2C\x2C\x31\x34\x37\x31\x32\x33\x35\x30\x36\x39\x33\x32\x34\x2E\x32\x66\x39\x32\x65\x64\x33\x34\x65\x35\x32\x62\x32\x38\x63\x34\x66\x36\x32\x66\x66\x37\x61\x61\x61\x30\x35\x62\x39\x61\x36\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 29. Total filtered/aggred row: 0. Time elapsed in EP: 133(ms). Server CPU usage: 0.5172370328354446, server physical mem left: 1.27258624E8, server swap mem left:5.144018944E9.Etc message: start latency: 154@92,agg done@130,compress done@131,server stats done@131, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:04,643 DEBUG [pool-6-thread-1] util.CompressionUtils:67 : Original: 99 bytes. Decompressed: 232 bytes. Time: 0 2016-08-15 06:40:04,670 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 29, 2016-08-15 06:40:04,671 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 2454, total scan count 29 2016-08-15 06:40:04,710 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table_60 User: ADMIN Success: true Duration: 2.454 Project: test_kylin Realization Names: [Test_Cube] Cuboid Ids: [31] Total scan count: 29 Result row count: 29 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:40:26,346 DEBUG [http-bio-7070-exec-11] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:40:26,343 DEBUG [http-bio-7070-exec-8] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 06:40:26,532 DEBUG [http-bio-7070-exec-8] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:40:26,707 INFO [http-bio-7070-exec-3] controller.TableController:95 : Return all table metadata in 2 seconds 2016-08-15 06:40:28,041 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:40:29,075 DEBUG [http-bio-7070-exec-10] service.CacheService:144 : Creating a new data source, OLAP data source pointing to kylin_metadata@hbase 2016-08-15 06:40:29,076 INFO [http-bio-7070-exec-10] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 06:40:29,078 INFO [http-bio-7070-exec-10] schema.OLAPSchemaFactory:135 : Schema json:{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 06:40:29,080 DEBUG [http-bio-7070-exec-10] service.CacheService:149 : The new temp olap json is :{ "version": "1.0", "defaultSchema": "DEFAULT", "schemas": [ { "type": "custom", "name": "DEFAULT", "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory", "operand": { "project": "KAFKA_STREAMING" }, "functions": [ { name: 'MASSIN', className: 'org.apache.kylin.query.udf.MassInUDF' } ] } ] } 2016-08-15 06:40:29,147 DEBUG [http-bio-7070-exec-10] service.QueryService:291 : getting table metas 2016-08-15 06:40:29,148 DEBUG [http-bio-7070-exec-10] service.QueryService:309 : getting column metas 2016-08-15 06:40:29,160 DEBUG [http-bio-7070-exec-10] service.QueryService:323 : done column metas 2016-08-15 06:40:34,898 INFO [http-bio-7070-exec-2] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 06:40:39,007 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:40:44,017 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:40:44,018 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select * from streaming_sales_table 2016-08-15 06:40:44,019 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select * from streaming_sales_table LIMIT 50000 2016-08-15 06:40:44,074 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:40:44,075 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@40c985c 2016-08-15 06:40:44,075 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:40:44,076 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:40:44,076 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:40:44,086 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:40:44,087 INFO [http-bio-7070-exec-3] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 06:40:44,088 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:40:44,088 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 06:40:44,089 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict 2016-08-15 06:40:44,092 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict 2016-08-15 06:40:44,096 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict 2016-08-15 06:40:44,100 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict 2016-08-15 06:40:44,103 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict 2016-08-15 06:40:44,106 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict 2016-08-15 06:40:44,114 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict 2016-08-15 06:40:44,118 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:40:44,138 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:40:44,139 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:40:44,139 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:40:44,144 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:40:44,146 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 06:40:44,147 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 27c2cc94 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:40:44,148 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:40:44,149 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:40:44,211 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:40:44,213 INFO [http-bio-7070-exec-3] dict.DictionaryManager:393 : DictionaryManager(172653899) loading DictionaryInfo(loadDictObj:true) at /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict 2016-08-15 06:40:44,217 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:40:44,219 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:40:44,219 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 1b41294f for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:40:44,221 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:40:44,222 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:40:44,222 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:40:44,225 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:40:44,227 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:40:44,228 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 2742ef77 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:40:44,233 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:40:44,234 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:40:44,234 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:40:44,236 INFO [pool-6-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 11(ms). Server CPU usage: 0.35064498790647675, server physical mem left: 1.33562368E8, server swap mem left:4.951568384E9.Etc message: start latency: 11@9,agg done@11,compress done@11,server stats done@11, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,242 DEBUG [pool-6-thread-1] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:40:44,244 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:40:44,247 INFO [pool-6-thread-2] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 15(ms). Server CPU usage: 0.5, server physical mem left: 1.33308416E8, server swap mem left:4.951568384E9.Etc message: start latency: 11@10,agg done@15,compress done@15,server stats done@15, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,247 DEBUG [pool-6-thread-2] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:40:44,247 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:40:44,249 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 46ad3df5 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:40:44,252 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:40:44,252 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:40:44,253 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:40:44,255 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:40:44,257 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:40:44,257 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 656a3e7 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:40:44,259 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:40:44,260 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:40:44,260 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:40:44,261 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:40:44,319 INFO [pool-6-thread-4] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 52(ms). Server CPU usage: 0.6153846153846154, server physical mem left: 1.32206592E8, server swap mem left:4.951568384E9.Etc message: start latency: 9@2,agg done@39,compress done@40,server stats done@52, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,320 DEBUG [pool-6-thread-4] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 06:40:44,346 INFO [pool-6-thread-3] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 100(ms). Server CPU usage: 0.7272727272727273, server physical mem left: 1.3195264E8, server swap mem left:4.951568384E9.Etc message: start latency: 9@0,agg done@70,compress done@71,server stats done@100, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,348 DEBUG [pool-6-thread-3] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 06:40:44,366 INFO [pool-6-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 83(ms). Server CPU usage: 0.0, server physical mem left: 1.3195264E8, server swap mem left:4.951568384E9.Etc message: start latency: 20@0,agg done@61,compress done@61,server stats done@83, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,367 DEBUG [pool-6-thread-7] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 1 2016-08-15 06:40:44,367 INFO [pool-6-thread-5] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 101(ms). Server CPU usage: 0.7894736842105263, server physical mem left: 1.3195264E8, server swap mem left:4.951568384E9.Etc message: start latency: 17@0,agg done@75,compress done@75,server stats done@101, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,372 DEBUG [pool-6-thread-5] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 06:40:44,372 INFO [pool-6-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 85(ms). Server CPU usage: 0.5, server physical mem left: 1.3195264E8, server swap mem left:4.951568384E9.Etc message: start latency: 20@9,agg done@64,compress done@64,server stats done@85, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,375 INFO [pool-6-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 72(ms). Server CPU usage: 1.0, server physical mem left: 1.3195264E8, server swap mem left:4.951568384E9.Etc message: start latency: 26@5,agg done@56,compress done@57,server stats done@72, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,376 DEBUG [pool-6-thread-8] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 06:40:44,376 INFO [pool-6-thread-9] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 85(ms). Server CPU usage: 0.75, server physical mem left: 1.31489792E8, server swap mem left:4.951568384E9.Etc message: start latency: 24@2,agg done@82,compress done@83,server stats done@85, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,378 DEBUG [pool-6-thread-9] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 06:40:44,374 INFO [pool-6-thread-6] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 106(ms). Server CPU usage: 0.0, server physical mem left: 1.3195264E8, server swap mem left:4.951568384E9.Etc message: start latency: 15@1,agg done@89,compress done@89,server stats done@106, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:40:44,379 DEBUG [pool-6-thread-6] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 06:40:44,376 DEBUG [pool-6-thread-1] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 0 2016-08-15 06:40:44,573 INFO [http-bio-7070-exec-3] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 06:40:44,574 INFO [http-bio-7070-exec-3] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 555, total scan count 598 2016-08-15 06:40:44,576 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table User: ADMIN Success: true Duration: 0.555 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:41:22,216 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:41:22,219 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select * from streaming_sales_table order by order_time 2016-08-15 06:41:22,220 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select * from streaming_sales_table order by order_time LIMIT 50000 2016-08-15 06:41:22,445 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:41:22,446 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@4a4c63f 2016-08-15 06:41:22,447 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:41:22,447 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:41:22,448 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:41:22,510 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:41:22,511 INFO [http-bio-7070-exec-3] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 06:41:22,511 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:41:22,512 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:41:22,514 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:41:22,514 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:41:22,515 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:41:22,515 WARN [http-bio-7070-exec-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:41:22,516 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 06:41:22,516 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan e2af507 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:41:22,518 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:41:22,518 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:41:22,518 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:41:22,520 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:41:22,522 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:41:22,524 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 3cfab16b for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:41:22,529 INFO [pool-6-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.0, server physical mem left: 1.20958976E8, server swap mem left:4.910051328E9.Etc message: start latency: 3@1,agg done@2,compress done@3,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,530 DEBUG [pool-6-thread-1] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:41:22,530 INFO [pool-6-thread-9] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.04230015541590648, server physical mem left: 1.20958976E8, server swap mem left:4.910051328E9.Etc message: start latency: 3@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,532 DEBUG [pool-6-thread-9] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:41:22,533 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:41:22,534 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:41:22,534 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:41:22,538 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:41:22,540 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:41:22,541 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 3f3b9225 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:41:22,544 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:41:22,544 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:41:22,545 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:41:22,547 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:41:22,548 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:41:22,549 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 69cc4927 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:41:22,551 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:41:22,552 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:41:22,553 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:41:22,565 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:41:22,567 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:41:22,567 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 3ca537f9 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:41:22,574 INFO [pool-6-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 26(ms). Server CPU usage: 0.8571428571428572, server physical mem left: 1.20705024E8, server swap mem left:4.910051328E9.Etc message: start latency: 3@0,agg done@25,compress done@25,server stats done@26, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,574 DEBUG [pool-6-thread-1] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 06:41:22,576 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:41:22,577 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:41:22,578 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:41:22,579 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:41:22,604 INFO [pool-6-thread-5] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 34(ms). Server CPU usage: 0.9090909090909091, server physical mem left: 1.20705024E8, server swap mem left:4.910051328E9.Etc message: start latency: 9@1,agg done@33,compress done@34,server stats done@34, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,611 DEBUG [pool-6-thread-5] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 06:41:22,611 INFO [pool-6-thread-6] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 63(ms). Server CPU usage: 0.75, server physical mem left: 1.20705024E8, server swap mem left:4.910051328E9.Etc message: start latency: 3@2,agg done@62,compress done@62,server stats done@63, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,615 DEBUG [pool-6-thread-6] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 06:41:22,618 INFO [pool-6-thread-3] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 36(ms). Server CPU usage: 1.0, server physical mem left: 1.20193024E8, server swap mem left:4.910051328E9.Etc message: start latency: 13@1,agg done@33,compress done@35,server stats done@36, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,622 DEBUG [pool-6-thread-3] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 0 2016-08-15 06:41:22,619 INFO [pool-6-thread-8] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 55(ms). Server CPU usage: 1.0, server physical mem left: 1.2046336E8, server swap mem left:4.910051328E9.Etc message: start latency: 11@1,agg done@50,compress done@50,server stats done@55, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,623 DEBUG [pool-6-thread-8] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 06:41:22,631 INFO [pool-6-thread-7] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 47(ms). Server CPU usage: 0.8, server physical mem left: 1.1890688E8, server swap mem left:4.910051328E9.Etc message: start latency: 24@1,agg done@46,compress done@47,server stats done@47, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,632 DEBUG [pool-6-thread-7] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 1 2016-08-15 06:41:22,633 INFO [pool-6-thread-1] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 18(ms). Server CPU usage: 1.0, server physical mem left: 1.1862016E8, server swap mem left:4.910051328E9.Etc message: start latency: 7@1,agg done@18,compress done@18,server stats done@18, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,637 DEBUG [pool-6-thread-1] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 06:41:22,642 INFO [pool-6-thread-4] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 28(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.18366208E8, server swap mem left:4.910051328E9.Etc message: start latency: 33@2,agg done@27,compress done@27,server stats done@28, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:41:22,642 DEBUG [pool-6-thread-4] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 06:41:22,768 INFO [http-bio-7070-exec-3] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 06:41:22,772 INFO [http-bio-7070-exec-3] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 553, total scan count 598 2016-08-15 06:41:22,773 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table order by order_time User: ADMIN Success: true Duration: 0.553 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:41:28,019 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:42:28,012 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:42:41,647 INFO [http-bio-7070-exec-7] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:42:41,648 INFO [http-bio-7070-exec-7] controller.QueryController:175 : The original query: select order_time, minute_start, category from streaming_sales_table order by order_time 2016-08-15 06:42:41,649 INFO [http-bio-7070-exec-7] service.QueryService:266 : The corrected query: select order_time, minute_start, category from streaming_sales_table order by order_time LIMIT 50000 2016-08-15 06:42:41,734 INFO [http-bio-7070-exec-7] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:42:41,734 INFO [http-bio-7070-exec-7] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@4a9ebfc5 2016-08-15 06:42:41,735 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:42:41,735 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:42:41,735 INFO [http-bio-7070-exec-7] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:42:41,796 DEBUG [http-bio-7070-exec-7] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:42:41,796 INFO [http-bio-7070-exec-7] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 06:42:41,796 INFO [http-bio-7070-exec-7] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:42:41,797 WARN [http-bio-7070-exec-7] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:42:41,799 WARN [http-bio-7070-exec-7] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:42:41,800 WARN [http-bio-7070-exec-7] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:42:41,800 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:42:41,800 WARN [http-bio-7070-exec-7] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:42:41,801 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1266 bytes, rawScanBytesString 63 bytes 2016-08-15 06:42:41,801 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 6f5f2a37 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:42:41,802 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:42:41,802 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:42:41,866 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:42:41,868 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:42:41,870 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:42:41,870 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 2093f6d4 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:42:41,872 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:42:41,872 INFO [pool-6-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 1.2699648E8, server swap mem left:4.9142784E9.Etc message: start latency: 1@1,agg done@2,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,873 DEBUG [pool-6-thread-10] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:42:41,873 INFO [pool-6-thread-11] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.05479851108593624, server physical mem left: 1.2699648E8, server swap mem left:4.9142784E9.Etc message: start latency: 1@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,874 DEBUG [pool-6-thread-11] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:42:41,873 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:42:41,875 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:42:41,876 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:42:41,877 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:42:41,878 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 6db4e7cc for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:42:41,879 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:42:41,880 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:42:41,880 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:42:41,890 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:42:41,890 INFO [pool-6-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.26787584E8, server swap mem left:4.9142784E9.Etc message: start latency: 1@1,agg done@8,compress done@8,server stats done@9, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,891 DEBUG [pool-6-thread-10] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:42:41,892 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:42:41,893 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan ff27cf7 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:42:41,894 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:42:41,894 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:42:41,895 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:42:41,905 INFO [pool-6-thread-12] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 0.5, server physical mem left: 1.26246912E8, server swap mem left:4.9142784E9.Etc message: start latency: 11@1,agg done@9,compress done@9,server stats done@9, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,906 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:42:41,909 DEBUG [pool-6-thread-12] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:42:41,910 INFO [pool-6-thread-14] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.0, server physical mem left: 1.26246912E8, server swap mem left:4.9142784E9.Etc message: start latency: 8@1,agg done@6,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,911 DEBUG [pool-6-thread-14] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:42:41,913 INFO [pool-6-thread-15] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 1.0, server physical mem left: 1.26246912E8, server swap mem left:4.9142784E9.Etc message: start latency: 1@2,agg done@8,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,913 DEBUG [pool-6-thread-15] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:42:41,913 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:42:41,915 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 3350daf9 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:42:41,916 INFO [pool-6-thread-13] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.5, server physical mem left: 1.26070784E8, server swap mem left:4.9142784E9.Etc message: start latency: 24@1,agg done@6,compress done@6,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,916 DEBUG [pool-6-thread-13] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:42:41,916 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:42:41,917 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:42:41,917 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:42:41,917 DEBUG [http-bio-7070-exec-7] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:42:41,935 INFO [pool-6-thread-14] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.75, server physical mem left: 1.25894656E8, server swap mem left:4.9142784E9.Etc message: start latency: 2@1,agg done@3,compress done@4,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,936 DEBUG [pool-6-thread-14] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:42:41,937 INFO [pool-6-thread-10] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 20(ms). Server CPU usage: 1.0, server physical mem left: 1.25640704E8, server swap mem left:4.9142784E9.Etc message: start latency: 19@1,agg done@19,compress done@19,server stats done@20, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,938 DEBUG [pool-6-thread-10] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:42:41,937 INFO [pool-6-thread-15] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 11(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.25640704E8, server swap mem left:4.9142784E9.Etc message: start latency: 5@1,agg done@10,compress done@10,server stats done@11, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:42:41,943 DEBUG [pool-6-thread-15] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:42:42,018 INFO [http-bio-7070-exec-7] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 06:42:42,019 INFO [http-bio-7070-exec-7] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 370, total scan count 598 2016-08-15 06:42:42,021 INFO [http-bio-7070-exec-7] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select order_time, minute_start, category from streaming_sales_table order by order_time User: ADMIN Success: true Duration: 0.37 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:43:28,007 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:44:28,099 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:44:46,388 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:44:46,390 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select * from streaming_sales_table order by order_time 2016-08-15 06:44:46,391 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select * from streaming_sales_table order by order_time LIMIT 50000 2016-08-15 06:44:46,466 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:44:46,466 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@2c81acf 2016-08-15 06:44:46,467 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:44:46,467 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:44:46,468 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:44:46,490 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:44:46,490 INFO [http-bio-7070-exec-9] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 06:44:46,491 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:44:46,492 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:46,493 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:46,494 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:46,494 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:46,494 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:46,495 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 06:44:46,495 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan e476933 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:46,496 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:46,496 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:46,557 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:46,562 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:46,563 INFO [pool-6-thread-16] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 1.24432384E8, server swap mem left:4.906881024E9.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,564 DEBUG [pool-6-thread-16] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:44:46,565 INFO [pool-6-thread-17] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.04986617253448631, server physical mem left: 1.24432384E8, server swap mem left:4.906881024E9.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,565 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:44:46,566 DEBUG [pool-6-thread-17] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:44:46,566 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 7505c6d2 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:46,568 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:46,569 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:46,569 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:46,571 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:46,572 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:44:46,573 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 747c24cd for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:46,574 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:46,574 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:46,574 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:46,576 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:46,577 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:44:46,577 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 544eb8d2 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:46,579 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:46,580 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:46,580 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:46,583 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:46,586 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 06:44:46,586 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 4cf8fbd2 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:46,588 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:46,588 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:46,589 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:46,590 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:44:46,608 INFO [pool-6-thread-18] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 36(ms). Server CPU usage: 0.7222222222222223, server physical mem left: 1.23551744E8, server swap mem left:4.906881024E9.Etc message: start latency: 2@1,agg done@35,compress done@35,server stats done@36, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,609 DEBUG [pool-6-thread-18] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 06:44:46,616 INFO [pool-6-thread-16] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 37(ms). Server CPU usage: 0.0, server physical mem left: 1.23551744E8, server swap mem left:4.906881024E9.Etc message: start latency: 2@5,agg done@35,compress done@35,server stats done@37, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,619 DEBUG [pool-6-thread-16] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 06:44:46,620 INFO [pool-6-thread-19] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 36(ms). Server CPU usage: 1.0, server physical mem left: 1.23375616E8, server swap mem left:4.906881024E9.Etc message: start latency: 2@1,agg done@33,compress done@33,server stats done@36, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,621 DEBUG [pool-6-thread-19] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 06:44:46,621 INFO [pool-6-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 21(ms). Server CPU usage: 1.0, server physical mem left: 1.23375616E8, server swap mem left:4.906881024E9.Etc message: start latency: 4@1,agg done@20,compress done@20,server stats done@21, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,622 DEBUG [pool-6-thread-21] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 0 2016-08-15 06:44:46,624 INFO [pool-6-thread-24] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 27(ms). Server CPU usage: 1.0, server physical mem left: 1.23375616E8, server swap mem left:4.906881024E9.Etc message: start latency: 2@1,agg done@26,compress done@26,server stats done@27, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,625 DEBUG [pool-6-thread-24] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 06:44:46,630 INFO [pool-6-thread-20] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 42(ms). Server CPU usage: 0.0, server physical mem left: 1.23375616E8, server swap mem left:4.906881024E9.Etc message: start latency: 7@1,agg done@42,compress done@42,server stats done@42, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,633 DEBUG [pool-6-thread-20] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 06:44:46,636 INFO [pool-6-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 42(ms). Server CPU usage: 0.75, server physical mem left: 1.23375616E8, server swap mem left:4.906881024E9.Etc message: start latency: 11@1,agg done@41,compress done@41,server stats done@42, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,637 DEBUG [pool-6-thread-22] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 0 2016-08-15 06:44:46,638 INFO [pool-6-thread-23] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 39(ms). Server CPU usage: 1.0, server physical mem left: 1.23375616E8, server swap mem left:4.906881024E9.Etc message: start latency: 6@1,agg done@38,compress done@39,server stats done@39, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:46,638 DEBUG [pool-6-thread-23] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 06:44:46,680 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 06:44:46,681 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 291, total scan count 598 2016-08-15 06:44:46,682 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table order by order_time User: ADMIN Success: true Duration: 0.291 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:44:56,588 INFO [http-bio-7070-exec-8] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:44:56,589 INFO [http-bio-7070-exec-8] controller.QueryController:175 : The original query: select order_time, minute_start, category from streaming_sales_table order by order_time 2016-08-15 06:44:56,590 INFO [http-bio-7070-exec-8] service.QueryService:266 : The corrected query: select order_time, minute_start, category from streaming_sales_table order by order_time LIMIT 50000 2016-08-15 06:44:56,713 INFO [http-bio-7070-exec-8] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:44:56,715 INFO [http-bio-7070-exec-8] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@1a26302d 2016-08-15 06:44:56,715 INFO [http-bio-7070-exec-8] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:44:56,716 INFO [http-bio-7070-exec-8] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:44:56,716 INFO [http-bio-7070-exec-8] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:44:56,769 DEBUG [http-bio-7070-exec-8] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:44:56,769 INFO [http-bio-7070-exec-8] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 06:44:56,770 INFO [http-bio-7070-exec-8] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:44:56,771 WARN [http-bio-7070-exec-8] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:56,772 WARN [http-bio-7070-exec-8] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:56,772 WARN [http-bio-7070-exec-8] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:56,772 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:56,773 WARN [http-bio-7070-exec-8] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 06:44:56,773 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1266 bytes, rawScanBytesString 63 bytes 2016-08-15 06:44:56,774 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 68f6554 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:56,774 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:56,775 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:56,874 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:56,881 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:56,883 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:44:56,883 INFO [pool-6-thread-23] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.04177088544272136, server physical mem left: 1.19791616E8, server swap mem left:4.91014144E9.Etc message: start latency: 2@1,agg done@3,compress done@3,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,883 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 23d05b1a for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:56,884 DEBUG [pool-6-thread-23] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:44:56,886 INFO [pool-6-thread-22] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 1.0, server physical mem left: 1.19791616E8, server swap mem left:4.91014144E9.Etc message: start latency: 2@4,agg done@7,compress done@7,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,886 DEBUG [pool-6-thread-22] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:44:56,886 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:56,887 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:56,887 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:56,890 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:56,891 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:44:56,892 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 75d63b21 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:56,894 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:56,894 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:56,894 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:56,905 INFO [pool-6-thread-23] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.6, server physical mem left: 1.19791616E8, server swap mem left:4.91014144E9.Etc message: start latency: 2@0,agg done@6,compress done@6,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,905 DEBUG [pool-6-thread-23] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:44:56,905 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:56,907 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:44:56,909 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 1d5630b1 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:56,910 INFO [pool-6-thread-20] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 13(ms). Server CPU usage: 1.0, server physical mem left: 1.19615488E8, server swap mem left:4.91014144E9.Etc message: start latency: 2@0,agg done@12,compress done@12,server stats done@13, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,910 DEBUG [pool-6-thread-20] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:44:56,911 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:56,918 INFO [pool-6-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 14(ms). Server CPU usage: 0.75, server physical mem left: 1.19615488E8, server swap mem left:4.91014144E9.Etc message: start latency: 7@1,agg done@14,compress done@14,server stats done@14, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,917 INFO [pool-6-thread-24] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 1.0, server physical mem left: 1.19615488E8, server swap mem left:4.91014144E9.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,919 DEBUG [pool-6-thread-21] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:44:56,919 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:56,920 DEBUG [pool-6-thread-24] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 1 2016-08-15 06:44:56,921 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:56,922 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:44:56,924 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 06:44:56,924 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:315 : The scan 36952ea9 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:44:56,925 INFO [http-bio-7070-exec-8] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:44:56,926 DEBUG [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:44:56,927 INFO [http-bio-7070-exec-8] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:44:56,927 DEBUG [http-bio-7070-exec-8] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:44:56,932 INFO [pool-6-thread-21] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.8, server physical mem left: 1.19615488E8, server swap mem left:4.91014144E9.Etc message: start latency: 1@2,agg done@6,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,934 DEBUG [pool-6-thread-21] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:44:56,935 INFO [pool-6-thread-23] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 0.0, server physical mem left: 1.19422976E8, server swap mem left:4.91014144E9.Etc message: start latency: 3@0,agg done@8,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,941 DEBUG [pool-6-thread-23] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 06:44:56,943 INFO [pool-6-thread-19] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.19169024E8, server swap mem left:4.91014144E9.Etc message: start latency: 8@1,agg done@5,compress done@5,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,944 DEBUG [pool-6-thread-19] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:44:56,959 INFO [pool-6-thread-16] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.8, server physical mem left: 1.19169024E8, server swap mem left:4.91014144E9.Etc message: start latency: 18@1,agg done@7,compress done@7,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:44:56,961 DEBUG [pool-6-thread-16] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 06:44:56,985 INFO [http-bio-7070-exec-8] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 06:44:56,986 INFO [http-bio-7070-exec-8] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 397, total scan count 598 2016-08-15 06:44:56,986 INFO [http-bio-7070-exec-8] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select order_time, minute_start, category from streaming_sales_table order by order_time User: ADMIN Success: true Duration: 0.397 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:45:28,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:46:28,083 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:47:28,044 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:48:28,010 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:49:28,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:50:28,094 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:51:28,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:52:28,008 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:53:28,003 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:54:28,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:55:28,180 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:56:03,199 DEBUG [http-bio-7070-exec-11] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:56:03,298 DEBUG [http-bio-7070-exec-4] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 06:56:03,398 DEBUG [http-bio-7070-exec-3] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 06:56:03,523 DEBUG [http-bio-7070-exec-1] service.QueryService:291 : getting table metas 2016-08-15 06:56:03,527 DEBUG [http-bio-7070-exec-1] service.QueryService:309 : getting column metas 2016-08-15 06:56:03,539 DEBUG [http-bio-7070-exec-1] service.QueryService:323 : done column metas 2016-08-15 06:56:05,916 INFO [http-bio-7070-exec-2] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:56:05,917 INFO [http-bio-7070-exec-2] controller.QueryController:175 : The original query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start 2016-08-15 06:56:05,919 INFO [http-bio-7070-exec-2] service.QueryService:266 : The corrected query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start LIMIT 50000 2016-08-15 06:56:06,247 INFO [http-bio-7070-exec-2] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:56:06,247 INFO [http-bio-7070-exec-2] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@479ac348 2016-08-15 06:56:06,248 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:56:06,248 INFO [http-bio-7070-exec-2] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:56:06,248 INFO [http-bio-7070-exec-2] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:56:06,413 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:56:06,420 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:56:06,420 INFO [http-bio-7070-exec-2] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 06:56:06,421 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:56:06,421 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:56:06,421 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 60a6468d for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:56:06,422 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:56:06,422 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:56:06,422 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:56:06,430 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:56:06,431 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:56:06,431 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 4ecc5286 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:56:06,432 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:56:06,432 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:56:06,432 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:56:06,436 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:56:06,437 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:56:06,438 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 31592f81 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:56:06,441 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:56:06,442 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:56:06,450 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:56:06,451 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:56:06,452 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:56:06,453 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 27dce3fc for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:56:06,453 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:56:06,455 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:56:06,455 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:56:06,457 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:56:06,459 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:56:06,460 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:315 : The scan 47b2f31b for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:56:06,460 INFO [http-bio-7070-exec-2] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:56:06,460 DEBUG [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:56:06,461 INFO [http-bio-7070-exec-2] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:56:06,461 DEBUG [http-bio-7070-exec-2] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:56:06,513 INFO [pool-6-thread-25] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 80(ms). Server CPU usage: 0.09627951893206331, server physical mem left: 1.39055104E8, server swap mem left:3.423637504E9.Etc message: start latency: 5@1,agg done@79,compress done@80,server stats done@80, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,514 DEBUG [pool-6-thread-25] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:56:06,523 INFO [pool-6-thread-26] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 87(ms). Server CPU usage: 0.5, server physical mem left: 1.37527296E8, server swap mem left:3.424489472E9.Etc message: start latency: 9@1,agg done@80,compress done@86,server stats done@87, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,523 DEBUG [pool-6-thread-26] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:56:06,587 INFO [pool-6-thread-28] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 94(ms). Server CPU usage: 0.6, server physical mem left: 1.26590976E8, server swap mem left:3.435163648E9.Etc message: start latency: 57@1,agg done@93,compress done@93,server stats done@94, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,587 DEBUG [pool-6-thread-28] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 06:56:06,594 INFO [pool-6-thread-34] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 99(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 1.26590976E8, server swap mem left:3.436343296E9.Etc message: start latency: 32@1,agg done@98,compress done@98,server stats done@99, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,594 DEBUG [pool-6-thread-34] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 06:56:06,628 INFO [pool-6-thread-29] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 133(ms). Server CPU usage: 0.5, server physical mem left: 1.35733248E8, server swap mem left:3.429363712E9.Etc message: start latency: 43@1,agg done@133,compress done@133,server stats done@133, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,629 DEBUG [pool-6-thread-29] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 06:56:06,634 INFO [pool-6-thread-31] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 141(ms). Server CPU usage: 0.0, server physical mem left: 1.3852672E8, server swap mem left:3.428040704E9.Etc message: start latency: 35@1,agg done@138,compress done@141,server stats done@141, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,634 DEBUG [pool-6-thread-31] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 06:56:06,640 INFO [http-bio-7070-exec-2] service.QueryService:399 : Scan count for each storageContext: 20, 2016-08-15 06:56:06,645 INFO [pool-6-thread-30] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 144(ms). Server CPU usage: 1.0, server physical mem left: 1.39034624E8, server swap mem left:3.428491264E9.Etc message: start latency: 43@0,agg done@143,compress done@143,server stats done@144, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,644 INFO [http-bio-7070-exec-2] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 725, total scan count 20 2016-08-15 06:56:06,645 DEBUG [pool-6-thread-30] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 06:56:06,646 INFO [pool-6-thread-27] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 151(ms). Server CPU usage: 0.0, server physical mem left: 1.38272768E8, server swap mem left:3.429126144E9.Etc message: start latency: 5@1,agg done@150,compress done@150,server stats done@151, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,646 INFO [http-bio-7070-exec-2] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start User: ADMIN Success: true Duration: 0.725 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [128] Total scan count: 20 Result row count: 20 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:56:06,646 DEBUG [pool-6-thread-27] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 06:56:06,647 INFO [pool-6-thread-33] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 150(ms). Server CPU usage: 1.0, server physical mem left: 1.38272768E8, server swap mem left:3.4292736E9.Etc message: start latency: 32@0,agg done@150,compress done@150,server stats done@150, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,648 DEBUG [pool-6-thread-33] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 06:56:06,649 INFO [pool-6-thread-32] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 156(ms). Server CPU usage: 0.0, server physical mem left: 1.38018816E8, server swap mem left:3.429531648E9.Etc message: start latency: 35@1,agg done@155,compress done@155,server stats done@156, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:56:06,651 DEBUG [pool-6-thread-32] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 06:56:28,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:57:28,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:57:37,885 INFO [http-bio-7070-exec-3] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 06:57:37,885 INFO [http-bio-7070-exec-3] controller.QueryController:175 : The original query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 06:57:37,886 INFO [http-bio-7070-exec-3] service.QueryService:266 : The corrected query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 06:57:38,021 INFO [http-bio-7070-exec-3] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 06:57:38,022 INFO [http-bio-7070-exec-3] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@de7b754 2016-08-15 06:57:38,022 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:57:38,023 INFO [http-bio-7070-exec-3] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 06:57:38,023 INFO [http-bio-7070-exec-3] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 06:57:38,188 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 06:57:38,189 INFO [http-bio-7070-exec-3] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 06:57:38,190 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:57:38,191 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:57:38,191 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 37d127ae for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:57:38,193 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:57:38,193 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:57:38,194 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:57:38,196 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:57:38,197 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:57:38,197 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 5474e3d9 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:57:38,198 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:57:38,199 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:57:38,199 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:57:38,206 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:57:38,207 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:57:38,207 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 5f92a255 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:57:38,208 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:57:38,209 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:57:38,209 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:57:38,206 INFO [pool-6-thread-36] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.03780760626398211, server physical mem left: 1.30260992E8, server swap mem left:3.431473152E9.Etc message: start latency: 9@0,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,209 DEBUG [pool-6-thread-36] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:57:38,211 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:57:38,213 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:57:38,214 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 54c92ffa for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:57:38,214 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:57:38,214 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:57:38,214 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:57:38,216 INFO [pool-6-thread-38] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 1.0, server physical mem left: 1.29798144E8, server swap mem left:3.431800832E9.Etc message: start latency: 8@1,agg done@0,compress done@0,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,216 DEBUG [pool-6-thread-38] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 06:57:38,222 INFO [pool-6-thread-37] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 1.0, server physical mem left: 1.29798144E8, server swap mem left:3.431878656E9.Etc message: start latency: 11@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,223 DEBUG [pool-6-thread-37] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 06:57:38,224 INFO [pool-6-thread-39] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 0(ms). Server CPU usage: 1.0, server physical mem left: 1.29544192E8, server swap mem left:3.432075264E9.Etc message: start latency: 4@1,agg done@3,compress done@3,server stats done@0, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,227 DEBUG [pool-6-thread-39] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 06:57:38,222 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 06:57:38,227 INFO [pool-6-thread-41] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.29257472E8, server swap mem left:3.432087552E9.Etc message: start latency: 8@0,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,226 INFO [pool-6-thread-35] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 15(ms). Server CPU usage: 0.0, server physical mem left: 1.29544192E8, server swap mem left:3.43207936E9.Etc message: start latency: 9@0,agg done@14,compress done@14,server stats done@15, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,228 DEBUG [pool-6-thread-35] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 06:57:38,228 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 06:57:38,226 INFO [pool-6-thread-36] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 1.0, server physical mem left: 1.29544192E8, server swap mem left:3.432083456E9.Etc message: start latency: 8@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,230 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:315 : The scan 694dfa4b for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 06:57:38,228 DEBUG [pool-6-thread-41] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 06:57:38,230 DEBUG [pool-6-thread-36] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 06:57:38,231 INFO [http-bio-7070-exec-3] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 06:57:38,232 DEBUG [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 06:57:38,232 INFO [http-bio-7070-exec-3] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 06:57:38,232 DEBUG [http-bio-7070-exec-3] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 06:57:38,238 INFO [pool-6-thread-41] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.29081344E8, server swap mem left:3.432173568E9.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,239 DEBUG [pool-6-thread-41] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 06:57:38,240 INFO [pool-6-thread-40] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 1.29257472E8, server swap mem left:3.432116224E9.Etc message: start latency: 11@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,240 DEBUG [pool-6-thread-40] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 06:57:38,243 INFO [pool-6-thread-39] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 1.29081344E8, server swap mem left:3.432185856E9.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 06:57:38,244 DEBUG [pool-6-thread-39] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 06:57:38,244 INFO [http-bio-7070-exec-3] service.QueryService:399 : Scan count for each storageContext: 20, 2016-08-15 06:57:38,245 INFO [http-bio-7070-exec-3] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 360, total scan count 20 2016-08-15 06:57:38,245 INFO [http-bio-7070-exec-3] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.36 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [128] Total scan count: 20 Result row count: 20 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 06:58:28,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 06:59:28,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:00:28,193 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:01:28,012 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:02:28,136 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:03:28,043 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:04:28,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:05:28,059 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:06:28,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:07:28,131 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:08:28,014 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:09:28,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:10:28,069 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:11:28,043 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:12:28,007 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:13:28,054 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:14:28,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:15:28,060 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:16:28,111 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:17:28,080 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:18:28,062 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:19:28,065 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:20:28,098 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:21:28,222 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:22:28,055 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:23:28,073 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:24:28,105 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:25:28,234 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:26:28,089 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:27:28,063 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:28:28,062 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:29:28,059 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:30:28,139 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:31:28,071 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:32:28,058 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:33:28,042 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:34:28,045 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:35:28,080 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:36:28,068 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:37:28,059 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:38:28,065 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:39:28,058 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:40:28,077 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:41:28,052 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:42:28,050 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:43:28,086 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:44:28,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:45:28,088 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:46:28,074 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:47:28,128 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:48:28,079 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:49:28,049 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:50:28,080 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:51:28,054 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:52:28,065 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:53:28,061 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:54:28,050 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:55:28,059 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:56:28,038 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:57:28,037 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:58:28,044 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 07:59:28,041 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:00:28,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:01:28,123 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:02:28,067 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:03:28,034 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:04:28,049 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:05:28,051 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:06:28,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:07:28,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:08:28,038 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:09:28,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:10:28,052 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:11:28,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:12:28,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:13:28,037 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:14:28,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:15:28,046 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:16:28,019 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:17:28,011 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:18:28,053 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:19:28,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:20:28,049 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:21:28,042 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:22:28,035 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:23:28,029 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:24:28,056 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:25:28,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:26:28,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:27:28,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:28:28,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:29:28,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:30:28,015 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:31:28,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:32:28,035 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:33:28,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:34:28,031 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:35:28,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:36:28,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:37:28,044 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:38:28,057 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:39:28,038 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:40:28,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:41:28,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:42:28,042 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:43:28,050 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:44:28,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:45:28,042 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:46:28,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:47:28,035 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:48:28,106 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:48:46,907 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 08:48:47,205 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 08:48:47,285 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 5 seconds 2016-08-15 08:48:58,051 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:48:58,053 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select order_time, minute_start, category from streaming_sales_table order by order_time 2016-08-15 08:48:58,059 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select order_time, minute_start, category from streaming_sales_table order by order_time LIMIT 50000 2016-08-15 08:48:58,245 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:48:58,248 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@3d4b047d 2016-08-15 08:48:58,248 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:48:58,249 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:48:58,249 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:48:58,381 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:48:58,382 INFO [http-bio-7070-exec-5] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 08:48:58,384 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:48:58,387 WARN [http-bio-7070-exec-5] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:48:58,392 WARN [http-bio-7070-exec-5] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:48:58,392 WARN [http-bio-7070-exec-5] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:48:58,393 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:48:58,393 WARN [http-bio-7070-exec-5] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:48:58,399 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1266 bytes, rawScanBytesString 63 bytes 2016-08-15 08:48:58,399 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 638b2617 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:48:58,402 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:48:58,402 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:48:58,699 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:48:58,704 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:48:58,713 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:48:58,713 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 4c872b53 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:48:58,718 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:48:58,719 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:48:58,722 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:48:58,724 INFO [pool-6-thread-43] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.07701208980332416, server physical mem left: 2.62742016E8, server swap mem left:1.10628864E8.Etc message: start latency: 13@2,agg done@2,compress done@4,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,730 DEBUG [pool-6-thread-43] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:48:58,732 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:48:58,735 INFO [pool-6-thread-42] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 1.0, server physical mem left: 2.62742016E8, server swap mem left:1.10698496E8.Etc message: start latency: 13@2,agg done@2,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,736 DEBUG [pool-6-thread-42] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 1 2016-08-15 08:48:58,740 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:48:58,751 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 71ebcf29 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:48:58,766 INFO [pool-6-thread-45] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 0.5625, server physical mem left: 2.60661248E8, server swap mem left:1.11652864E8.Etc message: start latency: 29@6,agg done@9,compress done@11,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,768 DEBUG [pool-6-thread-45] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 2 2016-08-15 08:48:58,770 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:48:58,772 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:48:58,771 INFO [pool-6-thread-44] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 15(ms). Server CPU usage: 0.0, server physical mem left: 2.60407296E8, server swap mem left:1.11816704E8.Etc message: start latency: 29@5,agg done@10,compress done@14,server stats done@15, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,772 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:48:58,773 DEBUG [pool-6-thread-44] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 08:48:58,778 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:48:58,786 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:48:58,787 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 5191ab3b for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:48:58,792 INFO [pool-6-thread-43] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.7142857142857142, server physical mem left: 2.58834432E8, server swap mem left:1.12635904E8.Etc message: start latency: 3@1,agg done@4,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,793 DEBUG [pool-6-thread-43] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 1 2016-08-15 08:48:58,794 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:48:58,796 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:48:58,795 INFO [pool-6-thread-45] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 1.0, server physical mem left: 2.58834432E8, server swap mem left:1.12705536E8.Etc message: start latency: 10@2,agg done@5,compress done@5,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,797 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:48:58,798 DEBUG [pool-6-thread-45] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 1 2016-08-15 08:48:58,806 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:48:58,810 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:48:58,815 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 76e38870 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:48:58,816 INFO [pool-6-thread-43] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.5714285714285714, server physical mem left: 2.57212416E8, server swap mem left:1.135616E8.Etc message: start latency: 7@1,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,819 DEBUG [pool-6-thread-43] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 3 2016-08-15 08:48:58,820 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:48:58,821 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:48:58,822 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:48:58,822 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:48:58,832 INFO [pool-6-thread-46] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.8, server physical mem left: 2.56704512E8, server swap mem left:1.14020352E8.Etc message: start latency: 16@4,agg done@7,compress done@7,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,836 DEBUG [pool-6-thread-46] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 1 2016-08-15 08:48:58,864 INFO [pool-6-thread-43] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 24(ms). Server CPU usage: 0.8333333333333334, server physical mem left: 2.54480384E8, server swap mem left:1.15245056E8.Etc message: start latency: 14@1,agg done@23,compress done@23,server stats done@24, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,869 DEBUG [pool-6-thread-43] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 1 2016-08-15 08:48:58,873 INFO [pool-6-thread-47] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 25(ms). Server CPU usage: 1.0, server physical mem left: 2.54480384E8, server swap mem left:1.15273728E8.Etc message: start latency: 13@1,agg done@24,compress done@24,server stats done@25, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:48:58,874 DEBUG [pool-6-thread-47] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 08:48:58,910 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 08:48:58,911 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 857, total scan count 598 2016-08-15 08:48:58,913 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select order_time, minute_start, category from streaming_sales_table order by order_time User: ADMIN Success: true Duration: 0.857 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:49:05,993 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 08:49:06,124 DEBUG [http-bio-7070-exec-8] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-08-15 08:49:28,041 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:50:05,446 INFO [http-bio-7070-exec-7] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:50:05,455 INFO [http-bio-7070-exec-7] controller.QueryController:175 : The original query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start 2016-08-15 08:50:05,458 INFO [http-bio-7070-exec-7] service.QueryService:266 : The corrected query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start LIMIT 50000 2016-08-15 08:50:05,605 INFO [http-bio-7070-exec-7] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:50:05,606 INFO [http-bio-7070-exec-7] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@1f49b261 2016-08-15 08:50:05,606 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:50:05,607 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:50:05,608 INFO [http-bio-7070-exec-7] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:50:05,809 DEBUG [http-bio-7070-exec-7] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:50:05,811 INFO [http-bio-7070-exec-7] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:50:05,811 INFO [http-bio-7070-exec-7] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 08:50:05,813 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:05,818 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:05,818 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 566573cb for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:05,821 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:05,821 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:05,823 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:05,826 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:05,835 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:05,837 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 1007311d for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:05,838 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.07952393832837436, server physical mem left: 2.44649984E8, server swap mem left:6.7354624E7.Etc message: start latency: 5@1,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:05,838 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:50:05,841 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:05,842 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:05,845 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:05,845 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.75, server physical mem left: 2.44125696E8, server swap mem left:6.7674112E7.Etc message: start latency: 15@1,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:05,846 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:50:05,854 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:05,925 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.7826086956521738, server physical mem left: 2.69484032E8, server swap mem left:6.8145152E7.Etc message: start latency: 64@1,agg done@2,compress done@5,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:05,926 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 1 2016-08-15 08:50:05,926 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:05,935 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 5b938826 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:05,937 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:05,938 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.8, server physical mem left: 2.69406208E8, server swap mem left:6.8431872E7.Etc message: start latency: 81@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:05,938 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:05,938 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:05,938 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:50:05,952 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:05,953 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.75, server physical mem left: 2.69328384E8, server swap mem left:6.8796416E7.Etc message: start latency: 1@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:05,953 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:50:05,956 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:05,957 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 69de10e7 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:05,963 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:05,964 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:05,964 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:06,004 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.8888888888888888, server physical mem left: 2.68263424E8, server swap mem left:6.93248E7.Etc message: start latency: 20@1,agg done@2,compress done@3,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:06,004 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:50:06,006 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 1.0, server physical mem left: 2.674688E8, server swap mem left:6.9361664E7.Etc message: start latency: 23@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:06,021 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 1 2016-08-15 08:50:06,010 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:06,027 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:06,028 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan def093c for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:06,031 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.9166666666666667, server physical mem left: 2.66166272E8, server swap mem left:6.9824512E7.Etc message: start latency: 53@0,agg done@2,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:06,039 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 5 2016-08-15 08:50:06,040 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:06,041 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:06,041 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:06,048 DEBUG [http-bio-7070-exec-7] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:50:06,063 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.875, server physical mem left: 2.64863744E8, server swap mem left:7.028736E7.Etc message: start latency: 4@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:06,063 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:50:06,069 INFO [http-bio-7070-exec-7] service.QueryService:399 : Scan count for each storageContext: 20, 2016-08-15 08:50:06,070 INFO [http-bio-7070-exec-7] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 613, total scan count 20 2016-08-15 08:50:06,071 INFO [http-bio-7070-exec-7] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start User: ADMIN Success: true Duration: 0.613 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [128] Total scan count: 20 Result row count: 20 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:50:06,099 INFO [pool-6-thread-53] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.5, server physical mem left: 2.6406912E8, server swap mem left:7.0680576E7.Etc message: start latency: 22@0,agg done@1,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:06,099 DEBUG [pool-6-thread-53] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:50:28,022 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:50:37,126 INFO [http-bio-7070-exec-5] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:50:37,127 INFO [http-bio-7070-exec-5] controller.QueryController:175 : The original query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 08:50:37,129 INFO [http-bio-7070-exec-5] service.QueryService:266 : The corrected query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 08:50:37,332 INFO [http-bio-7070-exec-5] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:50:37,332 INFO [http-bio-7070-exec-5] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@533f1b79 2016-08-15 08:50:37,333 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:50:37,333 INFO [http-bio-7070-exec-5] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:50:37,333 INFO [http-bio-7070-exec-5] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:50:37,460 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:50:37,461 INFO [http-bio-7070-exec-5] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:50:37,463 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:37,465 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:37,466 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 3e87aaed for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:37,468 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:37,468 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:37,469 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:37,472 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:37,481 INFO [pool-6-thread-53] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 1.0, server physical mem left: 3.616768E8, server swap mem left:2.2376448E7.Etc message: start latency: 2@1,agg done@1,compress done@5,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,481 DEBUG [pool-6-thread-53] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:50:37,481 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.28573883161512026, server physical mem left: 3.61947136E8, server swap mem left:2.2228992E7.Etc message: start latency: 2@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,481 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:37,482 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:50:37,483 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 53632e03 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:37,485 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:37,486 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:37,486 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:37,489 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:37,494 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:37,494 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 6fe5a7c6 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:37,497 INFO [pool-6-thread-53] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.4, server physical mem left: 3.61168896E8, server swap mem left:2.3011328E7.Etc message: start latency: 3@0,agg done@0,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,497 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:37,498 DEBUG [pool-6-thread-53] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:50:37,499 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:37,500 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:37,500 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.0, server physical mem left: 3.60374272E8, server swap mem left:2.340864E7.Etc message: start latency: 4@1,agg done@4,compress done@6,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,501 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:50:37,503 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:37,511 INFO [pool-6-thread-53] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.5, server physical mem left: 3.59673856E8, server swap mem left:2.3912448E7.Etc message: start latency: 3@1,agg done@2,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,511 DEBUG [pool-6-thread-53] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:50:37,513 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:37,513 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.0, server physical mem left: 3.59673856E8, server swap mem left:2.3986176E7.Etc message: start latency: 6@1,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,514 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 4690addd for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:37,514 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:50:37,517 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:37,518 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:37,518 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:37,522 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:50:37,530 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:50:37,530 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:315 : The scan 5ac4acda for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:50:37,530 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.0, server physical mem left: 3.58879232E8, server swap mem left:2.46784E7.Etc message: start latency: 2@1,agg done@0,compress done@4,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,531 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 08:50:37,531 INFO [pool-6-thread-53] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 3.58879232E8, server swap mem left:2.46784E7.Etc message: start latency: 4@1,agg done@4,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,532 DEBUG [pool-6-thread-53] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 08:50:37,532 INFO [http-bio-7070-exec-5] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:50:37,533 DEBUG [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:50:37,534 INFO [http-bio-7070-exec-5] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:50:37,535 DEBUG [http-bio-7070-exec-5] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:50:37,544 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 3.57593088E8, server swap mem left:2.541568E7.Etc message: start latency: 3@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,544 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:50:37,551 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.5, server physical mem left: 3.5678208E8, server swap mem left:2.5714688E7.Etc message: start latency: 8@1,agg done@2,compress done@5,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:50:37,552 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 1 2016-08-15 08:50:37,554 INFO [http-bio-7070-exec-5] service.QueryService:399 : Scan count for each storageContext: 20, 2016-08-15 08:50:37,555 INFO [http-bio-7070-exec-5] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 427, total scan count 20 2016-08-15 08:50:37,555 INFO [http-bio-7070-exec-5] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.427 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [128] Total scan count: 20 Result row count: 20 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:51:04,375 DEBUG [http-bio-7070-exec-8] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 08:51:04,683 DEBUG [http-bio-7070-exec-9] service.QueryService:291 : getting table metas 2016-08-15 08:51:04,685 DEBUG [http-bio-7070-exec-9] service.QueryService:309 : getting column metas 2016-08-15 08:51:04,691 DEBUG [http-bio-7070-exec-9] service.QueryService:323 : done column metas 2016-08-15 08:51:10,967 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:51:10,967 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select * from streaming_sales_table 2016-08-15 08:51:10,968 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select * from streaming_sales_table LIMIT 50000 2016-08-15 08:51:11,045 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:51:11,046 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@513253e5 2016-08-15 08:51:11,046 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:51:11,047 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:51:11,047 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:51:11,064 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:51:11,066 INFO [http-bio-7070-exec-9] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 08:51:11,067 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:51:11,068 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 08:51:11,069 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:11,071 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:11,072 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:11,072 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:11,072 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:11,075 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 08:51:11,076 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 115b30b for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:11,078 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:11,079 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:11,080 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:11,085 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:11,101 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:51:11,102 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 5782e9b2 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:11,106 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.2, server physical mem left: 3.36699392E8, server swap mem left:3.4463744E7.Etc message: start latency: 19@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,107 INFO [pool-6-thread-53] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.06029344337459881, server physical mem left: 3.3722368E8, server swap mem left:3.4177024E7.Etc message: start latency: 4@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,107 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:11,107 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:51:11,108 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:11,108 DEBUG [pool-6-thread-53] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 1 2016-08-15 08:51:11,110 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:11,114 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:11,119 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:51:11,119 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 422de660 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:11,124 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:11,134 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:11,134 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:11,136 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 10(ms). Server CPU usage: 0.75, server physical mem left: 3.35126528E8, server swap mem left:3.5467264E7.Etc message: start latency: 3@2,agg done@10,compress done@10,server stats done@10, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,142 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 3 2016-08-15 08:51:11,142 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.25, server physical mem left: 3.35126528E8, server swap mem left:3.5516416E7.Etc message: start latency: 15@0,agg done@6,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,153 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:11,175 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 11(ms). Server CPU usage: 0.8, server physical mem left: 3.34053376E8, server swap mem left:3.6184064E7.Etc message: start latency: 8@1,agg done@10,compress done@10,server stats done@10, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,172 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 13 2016-08-15 08:51:11,186 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:51:11,186 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 1 2016-08-15 08:51:11,183 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 3.3329152E8, server swap mem left:3.64544E7.Etc message: start latency: 20@1,agg done@9,compress done@11,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,187 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 383bb97a for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:11,188 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 08:51:11,196 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:11,196 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:11,197 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:11,206 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:11,211 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:51:11,212 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 6bd356c2 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:11,218 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:11,218 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:11,219 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:11,220 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:51:11,235 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.6875, server physical mem left: 3.29416704E8, server swap mem left:3.887104E7.Etc message: start latency: 10@1,agg done@8,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,238 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 13(ms). Server CPU usage: 0.5, server physical mem left: 3.289088E8, server swap mem left:3.9047168E7.Etc message: start latency: 7@1,agg done@12,compress done@13,server stats done@13, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,250 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 14 2016-08-15 08:51:11,257 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 19 2016-08-15 08:51:11,262 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.75, server physical mem left: 3.27081984E8, server swap mem left:4.0026112E7.Etc message: start latency: 18@1,agg done@18,compress done@18,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,265 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 1 2016-08-15 08:51:11,292 INFO [pool-6-thread-54] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 23(ms). Server CPU usage: 1.0, server physical mem left: 3.25558272E8, server swap mem left:4.1340928E7.Etc message: start latency: 36@2,agg done@22,compress done@22,server stats done@23, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:11,295 DEBUG [pool-6-thread-54] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 1 2016-08-15 08:51:11,406 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 08:51:11,414 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 445, total scan count 598 2016-08-15 08:51:11,414 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table User: ADMIN Success: true Duration: 0.445 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:51:28,055 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:51:28,315 INFO [http-bio-7070-exec-9] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:51:28,315 INFO [http-bio-7070-exec-9] controller.QueryController:175 : The original query: select minute_start--, count(*), sum(amount), sum(qty) from streaming_sales_table --group by minute_start order by minute_start 2016-08-15 08:51:28,317 INFO [http-bio-7070-exec-9] service.QueryService:266 : The corrected query: select minute_start--, count(*), sum(amount), sum(qty) from streaming_sales_table --group by minute_start order by minute_start LIMIT 50000 2016-08-15 08:51:28,880 INFO [http-bio-7070-exec-9] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:51:28,880 INFO [http-bio-7070-exec-9] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@6460f16c 2016-08-15 08:51:28,881 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:51:28,881 INFO [http-bio-7070-exec-9] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:51:28,882 INFO [http-bio-7070-exec-9] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:51:28,916 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:51:28,916 INFO [http-bio-7070-exec-9] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 08:51:28,917 INFO [http-bio-7070-exec-9] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:51:28,917 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:28,918 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:28,918 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:28,918 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:28,919 WARN [http-bio-7070-exec-9] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:51:28,919 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1266 bytes, rawScanBytesString 63 bytes 2016-08-15 08:51:28,920 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 2bf489cf for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:28,920 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:28,921 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:28,921 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:28,923 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:28,932 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:51:28,933 INFO [pool-6-thread-54] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.03732866724992709, server physical mem left: 2.29117952E8, server swap mem left:7.757824E7.Etc message: start latency: 3@1,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,933 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.5, server physical mem left: 2.28847616E8, server swap mem left:7.763968E7.Etc message: start latency: 6@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,934 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:51:28,933 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 21bf9af1 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:28,934 DEBUG [pool-6-thread-54] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:51:28,936 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:28,937 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:28,937 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:28,948 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:28,950 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:51:28,950 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 3e4b2662 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:28,951 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:28,952 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:28,954 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:28,960 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 0.8333333333333333, server physical mem left: 2.2808576E8, server swap mem left:7.8675968E7.Etc message: start latency: 4@0,agg done@6,compress done@6,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,963 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 08:51:28,966 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 0.0, server physical mem left: 2.2808576E8, server swap mem left:7.8675968E7.Etc message: start latency: 4@2,agg done@6,compress done@6,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,974 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 735 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 08:51:28,975 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:28,976 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.0, server physical mem left: 2.27495936E8, server swap mem left:7.8893056E7.Etc message: start latency: 8@1,agg done@5,compress done@5,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,975 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.6666666666666667, server physical mem left: 2.27495936E8, server swap mem left:7.8893056E7.Etc message: start latency: 8@0,agg done@4,compress done@4,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,976 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 08:51:28,977 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 745 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 08:51:28,978 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:51:28,979 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 7c4848f4 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:28,980 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:28,980 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:28,980 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:28,989 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:28,990 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1271 bytes, rawScanBytesString 71 bytes 2016-08-15 08:51:28,990 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:315 : The scan 468605f7 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:28,992 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.8, server physical mem left: 2.26971648E8, server swap mem left:7.8962688E7.Etc message: start latency: 2@1,agg done@0,compress done@0,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,995 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.5, server physical mem left: 2.26971648E8, server swap mem left:7.8966784E7.Etc message: start latency: 6@0,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:28,995 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 08:51:28,992 INFO [http-bio-7070-exec-9] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:28,995 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 728 bytes. Decompressed: 2850 bytes. Time: 0 2016-08-15 08:51:28,997 DEBUG [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:28,998 INFO [http-bio-7070-exec-9] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:28,999 DEBUG [http-bio-7070-exec-9] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:51:29,011 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.5, server physical mem left: 2.26177024E8, server swap mem left:7.90528E7.Etc message: start latency: 2@2,agg done@5,compress done@0,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:29,011 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 08:51:29,014 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 2.25476608E8, server swap mem left:7.9327232E7.Etc message: start latency: 7@1,agg done@6,compress done@7,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:29,016 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 741 bytes. Decompressed: 2831 bytes. Time: 0 2016-08-15 08:51:29,158 INFO [http-bio-7070-exec-9] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 08:51:29,158 INFO [http-bio-7070-exec-9] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 842, total scan count 598 2016-08-15 08:51:29,159 INFO [http-bio-7070-exec-9] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start--, count(*), sum(amount), sum(qty) from streaming_sales_table --group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.842 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:51:52,129 INFO [http-bio-7070-exec-4] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:51:52,130 INFO [http-bio-7070-exec-4] controller.QueryController:175 : The original query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 08:51:52,131 INFO [http-bio-7070-exec-4] service.QueryService:266 : The corrected query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 08:51:52,351 INFO [http-bio-7070-exec-4] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:51:52,352 INFO [http-bio-7070-exec-4] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@273583cd 2016-08-15 08:51:52,359 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:51:52,360 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:51:52,360 INFO [http-bio-7070-exec-4] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:51:52,539 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:51:52,541 INFO [http-bio-7070-exec-4] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:51:52,553 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:52,556 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:51:52,556 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 5449b3ca for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:52,557 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:52,558 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:52,930 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:52,934 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:52,938 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.05313906149560746, server physical mem left: 1.55942912E8, server swap mem left:1.1216896E8.Etc message: start latency: 2@1,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,938 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 1.55942912E8, server swap mem left:1.12173056E8.Etc message: start latency: 2@1,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,938 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:51:52,939 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:51:52,939 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:51:52,939 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 4bec83bb for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:52,941 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:52,941 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:52,941 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:52,943 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:52,949 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:51:52,950 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 1ff5b74d for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:52,950 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.75, server physical mem left: 1.54894336E8, server swap mem left:1.1261952E8.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,951 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:51:52,951 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 1(ms). Server CPU usage: 0.0, server physical mem left: 1.54734592E8, server swap mem left:1.12648192E8.Etc message: start latency: 5@0,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,951 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:51:52,952 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:52,953 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:52,954 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:52,956 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:52,960 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:51:52,964 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 49f8ba78 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:52,963 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 1.53526272E8, server swap mem left:1.12898048E8.Etc message: start latency: 3@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,966 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 1 2016-08-15 08:51:52,965 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.75, server physical mem left: 1.53526272E8, server swap mem left:1.12898048E8.Etc message: start latency: 3@0,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,966 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:51:52,966 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:52,967 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:52,968 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:52,978 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:51:52,984 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:51:52,984 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 35143d91 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:51:52,985 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 1.0, server physical mem left: 1.52748032E8, server swap mem left:1.13340416E8.Etc message: start latency: 10@0,agg done@1,compress done@2,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,985 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 08:51:52,984 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.8, server physical mem left: 1.52748032E8, server swap mem left:1.13225728E8.Etc message: start latency: 8@1,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,985 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 08:51:52,987 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:51:52,988 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:51:52,988 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:51:52,988 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:51:52,996 INFO [pool-6-thread-54] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 1.0, server physical mem left: 1.52240128E8, server swap mem left:1.13606656E8.Etc message: start latency: 3@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,996 DEBUG [pool-6-thread-54] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:51:52,997 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 1.52240128E8, server swap mem left:1.13606656E8.Etc message: start latency: 3@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:51:52,997 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:51:53,000 INFO [http-bio-7070-exec-4] service.QueryService:399 : Scan count for each storageContext: 20, 2016-08-15 08:51:53,000 INFO [http-bio-7070-exec-4] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 870, total scan count 20 2016-08-15 08:51:53,001 INFO [http-bio-7070-exec-4] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.87 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [128] Total scan count: 20 Result row count: 20 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:52:28,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:52:38,754 INFO [http-bio-7070-exec-7] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:52:38,754 INFO [http-bio-7070-exec-7] controller.QueryController:175 : The original query: select count(*) from streaming_sales_table 2016-08-15 08:52:38,756 INFO [http-bio-7070-exec-7] service.QueryService:266 : The corrected query: select count(*) from streaming_sales_table LIMIT 50000 2016-08-15 08:52:38,830 INFO [http-bio-7070-exec-7] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:52:38,830 INFO [http-bio-7070-exec-7] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@7d3e76be 2016-08-15 08:52:38,831 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:52:38,832 INFO [http-bio-7070-exec-7] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:52:38,832 INFO [http-bio-7070-exec-7] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:52:38,951 DEBUG [http-bio-7070-exec-7] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:52:38,953 INFO [http-bio-7070-exec-7] v2.CubeStorageQuery:222 : exactAggregation is false because cuboid 0=> 8 2016-08-15 08:52:38,955 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:52:38,958 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 08:52:38,959 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan d55a1d for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:52:38,962 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 08:52:38,962 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:52:38,963 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:52:38,964 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:52:38,969 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 08:52:38,969 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 7c9b27f4 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:52:38,970 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 08:52:38,971 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:52:38,971 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:52:38,978 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:52:38,981 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 08:52:38,981 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 343d9b9e for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:52:38,983 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 08:52:38,984 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:52:38,986 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:52:38,994 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:52:39,022 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 08:52:39,024 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 3fca65a8 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:52:39,029 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 46(ms). Server CPU usage: 1.0, server physical mem left: 1.4739456E8, server swap mem left:1.2259328E8.Etc message: start latency: 5@1,agg done@40,compress done@41,server stats done@46, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,030 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,032 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 08:52:39,035 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:52:39,035 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 8. Total filtered/aggred row: 7. Time elapsed in EP: 59(ms). Server CPU usage: 0.03573608567782032, server physical mem left: 1.4739456E8, server swap mem left:1.2261376E8.Etc message: start latency: 2@0,agg done@53,compress done@53,server stats done@59, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,041 INFO [pool-6-thread-54] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 46(ms). Server CPU usage: 1.0, server physical mem left: 1.4739456E8, server swap mem left:1.2259328E8.Etc message: start latency: 2@1,agg done@40,compress done@42,server stats done@46, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,044 DEBUG [pool-6-thread-54] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,035 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:52:39,045 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 36(ms). Server CPU usage: 0.0, server physical mem left: 1.4739456E8, server swap mem left:1.22621952E8.Etc message: start latency: 2@0,agg done@28,compress done@28,server stats done@36, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,045 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,045 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 38(ms). Server CPU usage: 0.0, server physical mem left: 1.47140608E8, server swap mem left:1.2271616E8.Etc message: start latency: 6@1,agg done@28,compress done@30,server stats done@38, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,045 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 8. Total filtered/aggred row: 7. Time elapsed in EP: 65(ms). Server CPU usage: 0.5, server physical mem left: 1.4739456E8, server swap mem left:1.22699776E8.Etc message: start latency: 2@0,agg done@57,compress done@57,server stats done@65, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,041 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,046 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,046 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,047 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:52:39,050 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 08:52:39,051 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:315 : The scan 2e4b8081 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:52:39,051 INFO [http-bio-7070-exec-7] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 08:52:39,052 DEBUG [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:52:39,052 INFO [http-bio-7070-exec-7] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:52:39,053 DEBUG [http-bio-7070-exec-7] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:52:39,078 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 22(ms). Server CPU usage: 0.0, server physical mem left: 1.4589952E8, server swap mem left:1.23035648E8.Etc message: start latency: 4@0,agg done@19,compress done@21,server stats done@22, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,078 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,084 INFO [pool-6-thread-55] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 19(ms). Server CPU usage: 0.7692307692307693, server physical mem left: 1.46075648E8, server swap mem left:1.23031552E8.Etc message: start latency: 4@0,agg done@19,compress done@19,server stats done@19, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,086 DEBUG [pool-6-thread-55] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,086 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 1.4589952E8, server swap mem left:1.23035648E8.Etc message: start latency: 17@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,088 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 1 2016-08-15 08:52:39,094 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 0(ms). Server CPU usage: 1.0, server physical mem left: 1.4589952E8, server swap mem left:1.23035648E8.Etc message: start latency: 15@0,agg done@1,compress done@1,server stats done@0, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:52:39,094 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 08:52:39,096 INFO [http-bio-7070-exec-7] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 08:52:39,096 INFO [http-bio-7070-exec-7] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 341, total scan count 5 2016-08-15 08:52:39,097 INFO [http-bio-7070-exec-7] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select count(*) from streaming_sales_table User: ADMIN Success: true Duration: 0.341 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [8] Total scan count: 5 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:53:13,313 INFO [http-bio-7070-exec-11] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:53:13,313 INFO [http-bio-7070-exec-11] controller.QueryController:175 : The original query: select * from streaming_sales_table 2016-08-15 08:53:13,314 INFO [http-bio-7070-exec-11] service.QueryService:266 : The corrected query: select * from streaming_sales_table LIMIT 50000 2016-08-15 08:53:13,375 INFO [http-bio-7070-exec-11] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:53:13,375 INFO [http-bio-7070-exec-11] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@6493e826 2016-08-15 08:53:13,375 INFO [http-bio-7070-exec-11] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:53:13,376 INFO [http-bio-7070-exec-11] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:53:13,376 INFO [http-bio-7070-exec-11] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:53:13,399 DEBUG [http-bio-7070-exec-11] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:53:13,403 INFO [http-bio-7070-exec-11] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 08:53:13,406 INFO [http-bio-7070-exec-11] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:53:13,406 INFO [http-bio-7070-exec-11] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 08:53:13,409 WARN [http-bio-7070-exec-11] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:53:13,413 WARN [http-bio-7070-exec-11] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:53:13,414 WARN [http-bio-7070-exec-11] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:53:13,414 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:53:13,414 WARN [http-bio-7070-exec-11] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:53:13,415 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 08:53:13,415 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:315 : The scan 30f55105 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:53:13,416 INFO [http-bio-7070-exec-11] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:53:13,417 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:53:13,601 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:53:13,603 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:53:13,605 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:53:13,606 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:315 : The scan 7eeb23f2 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:53:13,610 INFO [http-bio-7070-exec-11] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:53:13,611 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:53:13,612 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:53:13,614 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.07186782247906942, server physical mem left: 1.2546048E8, server swap mem left:1.32624384E8.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,614 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:53:13,615 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:53:13,619 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:53:13,620 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:315 : The scan 5b3591c2 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:53:13,628 INFO [pool-6-thread-52] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.5, server physical mem left: 1.250304E8, server swap mem left:1.3279232E8.Etc message: start latency: 5@3,agg done@4,compress done@4,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,628 DEBUG [pool-6-thread-52] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:53:13,630 INFO [http-bio-7070-exec-11] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:53:13,631 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:53:13,632 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:53:13,639 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:53:13,648 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.7777777777777778, server physical mem left: 1.24268544E8, server swap mem left:1.33066752E8.Etc message: start latency: 4@1,agg done@5,compress done@5,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,648 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 08:53:13,652 INFO [pool-6-thread-55] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 1.0, server physical mem left: 1.24268544E8, server swap mem left:1.33111808E8.Etc message: start latency: 16@1,agg done@11,compress done@11,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,653 DEBUG [pool-6-thread-55] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 08:53:13,660 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 1.24268544E8, server swap mem left:1.33152768E8.Etc message: start latency: 4@1,agg done@7,compress done@7,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,660 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 08:53:13,661 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:53:13,661 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:315 : The scan 70eda09b for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:53:13,662 INFO [http-bio-7070-exec-11] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:53:13,663 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:53:13,669 INFO [pool-6-thread-50] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.6000000000000001, server physical mem left: 1.23457536E8, server swap mem left:1.33500928E8.Etc message: start latency: 20@1,agg done@7,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,670 DEBUG [pool-6-thread-50] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 0 2016-08-15 08:53:13,670 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:53:13,674 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:53:13,680 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:53:13,680 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:315 : The scan 5d5e9ea5 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:53:13,683 INFO [http-bio-7070-exec-11] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:53:13,685 DEBUG [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:53:13,685 INFO [http-bio-7070-exec-11] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:53:13,687 DEBUG [http-bio-7070-exec-11] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:53:13,699 INFO [pool-6-thread-49] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.6666666666666667, server physical mem left: 1.22679296E8, server swap mem left:1.33824512E8.Etc message: start latency: 7@1,agg done@7,compress done@7,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,700 INFO [pool-6-thread-48] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 11(ms). Server CPU usage: 1.0, server physical mem left: 1.22679296E8, server swap mem left:1.33824512E8.Etc message: start latency: 2@1,agg done@10,compress done@10,server stats done@11, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,700 DEBUG [pool-6-thread-49] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 0 2016-08-15 08:53:13,700 DEBUG [pool-6-thread-48] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 0 2016-08-15 08:53:13,714 INFO [pool-6-thread-51] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.5, server physical mem left: 1.22392576E8, server swap mem left:1.33885952E8.Etc message: start latency: 17@1,agg done@7,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,715 DEBUG [pool-6-thread-51] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 08:53:13,716 INFO [pool-6-thread-54] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 1.0, server physical mem left: 1.22376192E8, server swap mem left:1.33894144E8.Etc message: start latency: 17@1,agg done@8,compress done@8,server stats done@9, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:53:13,717 DEBUG [pool-6-thread-54] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 1 2016-08-15 08:53:13,818 INFO [http-bio-7070-exec-11] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 08:53:13,818 INFO [http-bio-7070-exec-11] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 505, total scan count 598 2016-08-15 08:53:13,819 INFO [http-bio-7070-exec-11] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table User: ADMIN Success: true Duration: 0.505 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:53:28,103 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:54:28,000 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:55:28,006 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:55:40,669 INFO [http-bio-7070-exec-1] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:55:40,670 INFO [http-bio-7070-exec-1] controller.QueryController:175 : The original query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start 2016-08-15 08:55:40,671 INFO [http-bio-7070-exec-1] service.QueryService:266 : The corrected query: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start LIMIT 50000 2016-08-15 08:55:40,816 INFO [http-bio-7070-exec-1] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:55:40,817 INFO [http-bio-7070-exec-1] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@547c342b 2016-08-15 08:55:40,817 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:55:40,818 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:55:40,819 INFO [http-bio-7070-exec-1] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:55:40,909 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:55:40,909 INFO [http-bio-7070-exec-1] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:55:40,912 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:40,915 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:55:40,916 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 51275473 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:40,916 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:40,916 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:41,048 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:41,051 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:41,054 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.11103040181418751, server physical mem left: 3.89627904E8, server swap mem left:1.5007744E7.Etc message: start latency: 1@1,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,056 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 1 2016-08-15 08:55:41,056 INFO [pool-6-thread-57] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.89341184E8, server swap mem left:1.5028224E7.Etc message: start latency: 3@1,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,058 DEBUG [pool-6-thread-57] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:55:41,058 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:55:41,059 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 4006c0df for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:41,060 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:41,061 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:41,061 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:41,063 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:41,066 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:55:41,068 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 0(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 3.88816896E8, server swap mem left:1.5302656E7.Etc message: start latency: 2@1,agg done@0,compress done@0,server stats done@0, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,068 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 62b7ee36 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:41,068 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:55:41,069 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:41,070 INFO [pool-6-thread-58] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 1.0, server physical mem left: 3.88816896E8, server swap mem left:1.5327232E7.Etc message: start latency: 5@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,070 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:41,070 DEBUG [pool-6-thread-58] util.CompressionUtils:67 : Original: 65 bytes. Decompressed: 65 bytes. Time: 0 2016-08-15 08:55:41,071 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:41,084 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:41,086 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 3.87989504E8, server swap mem left:1.536E7.Etc message: start latency: 2@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,086 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:55:41,087 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:55:41,090 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 4725568d for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:41,092 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:41,092 INFO [pool-6-thread-59] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.5, server physical mem left: 3.87813376E8, server swap mem left:1.554432E7.Etc message: start latency: 16@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,093 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:41,093 DEBUG [pool-6-thread-59] util.CompressionUtils:67 : Original: 59 bytes. Decompressed: 61 bytes. Time: 0 2016-08-15 08:55:41,093 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:41,100 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:41,105 INFO [pool-6-thread-60] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.8754304E8, server swap mem left:1.5642624E7.Etc message: start latency: 3@0,agg done@1,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,105 DEBUG [pool-6-thread-60] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 08:55:41,106 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 275 bytes, rawScanBytesString 46 bytes 2016-08-15 08:55:41,106 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 71f5f615 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:41,106 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.5, server physical mem left: 3.8754304E8, server swap mem left:1.5642624E7.Etc message: start latency: 2@1,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,106 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 64 bytes. Time: 0 2016-08-15 08:55:41,107 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 128 to 128 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x80\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:41,107 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:41,107 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:41,108 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:55:41,119 INFO [pool-6-thread-60] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.75, server physical mem left: 3.87080192E8, server swap mem left:1.574912E7.Etc message: start latency: 2@0,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,120 DEBUG [pool-6-thread-60] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:55:41,125 INFO [http-bio-7070-exec-1] service.QueryService:399 : Scan count for each storageContext: 20, 2016-08-15 08:55:41,125 INFO [pool-6-thread-61] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 5. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 3.87080192E8, server swap mem left:1.5839232E7.Etc message: start latency: 13@0,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:41,125 INFO [http-bio-7070-exec-1] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 455, total scan count 20 2016-08-15 08:55:41,125 DEBUG [pool-6-thread-61] util.CompressionUtils:67 : Original: 62 bytes. Decompressed: 63 bytes. Time: 0 2016-08-15 08:55:41,126 INFO [http-bio-7070-exec-1] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select minute_start, count(*), sum(amount), sum(qty) from streaming_sales_table group by minute_start order by minute_start User: ADMIN Success: true Duration: 0.455 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [128] Total scan count: 20 Result row count: 20 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:55:46,068 INFO [http-bio-7070-exec-1] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 08:55:46,069 INFO [http-bio-7070-exec-1] controller.QueryController:175 : The original query: select * from streaming_sales_table 2016-08-15 08:55:46,069 INFO [http-bio-7070-exec-1] service.QueryService:266 : The corrected query: select * from streaming_sales_table LIMIT 50000 2016-08-15 08:55:46,119 INFO [http-bio-7070-exec-1] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 08:55:46,119 INFO [http-bio-7070-exec-1] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@6f6cc773 2016-08-15 08:55:46,120 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:55:46,120 INFO [http-bio-7070-exec-1] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 08:55:46,120 INFO [http-bio-7070-exec-1] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 08:55:46,132 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 08:55:46,132 INFO [http-bio-7070-exec-1] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 08:55:46,133 INFO [http-bio-7070-exec-1] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 08:55:46,133 INFO [http-bio-7070-exec-1] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 08:55:46,134 WARN [http-bio-7070-exec-1] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:55:46,135 WARN [http-bio-7070-exec-1] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:55:46,136 WARN [http-bio-7070-exec-1] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:55:46,136 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:46,137 WARN [http-bio-7070-exec-1] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 08:55:46,139 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 08:55:46,139 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 61059df2 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:46,141 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:46,141 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:46,142 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:46,151 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 2(ms). Server CPU usage: 0.03266972945380296, server physical mem left: 3.83930368E8, server swap mem left:1.7760256E7.Etc message: start latency: 3@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,151 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:46,151 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:55:46,152 INFO [pool-6-thread-61] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 1.0, server physical mem left: 3.83930368E8, server swap mem left:1.7764352E7.Etc message: start latency: 3@1,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,153 DEBUG [pool-6-thread-61] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 08:55:46,154 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:55:46,154 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 5527b445 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:46,156 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:46,156 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:46,156 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:46,162 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:46,174 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.375, server physical mem left: 3.83676416E8, server swap mem left:1.8096128E7.Etc message: start latency: 1@1,agg done@7,compress done@7,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,178 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:55:46,178 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 3d1a20dc for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:46,180 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 4 2016-08-15 08:55:46,182 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:46,182 INFO [pool-6-thread-59] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 15(ms). Server CPU usage: 0.75, server physical mem left: 3.8311936E8, server swap mem left:1.8280448E7.Etc message: start latency: 6@1,agg done@15,compress done@15,server stats done@15, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,183 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:46,184 DEBUG [pool-6-thread-59] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 0 2016-08-15 08:55:46,184 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:46,187 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:46,194 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:55:46,195 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan 20836aca for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:46,196 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:46,196 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:46,197 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:46,198 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 08:55:46,202 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 08:55:46,203 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:315 : The scan fc71319 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 08:55:46,210 INFO [pool-6-thread-60] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 12(ms). Server CPU usage: 0.0, server physical mem left: 3.820544E8, server swap mem left:1.8640896E7.Etc message: start latency: 2@1,agg done@11,compress done@11,server stats done@12, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,210 INFO [http-bio-7070-exec-1] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 08:55:46,212 DEBUG [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 08:55:46,212 INFO [http-bio-7070-exec-1] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 08:55:46,213 INFO [pool-6-thread-56] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 10(ms). Server CPU usage: 0.8571428571428572, server physical mem left: 3.82324736E8, server swap mem left:1.86368E7.Etc message: start latency: 4@1,agg done@9,compress done@10,server stats done@10, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,214 DEBUG [pool-6-thread-60] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 4 2016-08-15 08:55:46,215 DEBUG [pool-6-thread-56] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 2 2016-08-15 08:55:46,218 DEBUG [http-bio-7070-exec-1] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 08:55:46,248 INFO [pool-6-thread-58] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 26(ms). Server CPU usage: 0.7777777777777778, server physical mem left: 3.80813312E8, server swap mem left:1.9165184E7.Etc message: start latency: 23@1,agg done@24,compress done@25,server stats done@26, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,249 DEBUG [pool-6-thread-58] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 1 2016-08-15 08:55:46,255 INFO [pool-6-thread-57] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 0.7142857142857142, server physical mem left: 3.813376E8, server swap mem left:1.8788352E7.Etc message: start latency: 15@1,agg done@7,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,257 INFO [pool-6-thread-62] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 21(ms). Server CPU usage: 1.0, server physical mem left: 3.80813312E8, server swap mem left:1.9234816E7.Etc message: start latency: 11@0,agg done@20,compress done@20,server stats done@21, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,258 DEBUG [pool-6-thread-62] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 1 2016-08-15 08:55:46,260 DEBUG [pool-6-thread-57] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 4 2016-08-15 08:55:46,261 INFO [pool-6-thread-63] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 22(ms). Server CPU usage: 0.0, server physical mem left: 3.8055936E8, server swap mem left:1.9279872E7.Etc message: start latency: 14@1,agg done@21,compress done@22,server stats done@22, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 08:55:46,261 DEBUG [pool-6-thread-63] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 0 2016-08-15 08:55:46,310 INFO [http-bio-7070-exec-1] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 08:55:46,311 INFO [http-bio-7070-exec-1] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 242, total scan count 598 2016-08-15 08:55:46,312 INFO [http-bio-7070-exec-1] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table User: ADMIN Success: true Duration: 0.242 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 08:56:28,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:57:28,012 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:58:28,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 08:59:28,079 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:00:28,017 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:01:28,032 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:02:27,997 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:03:28,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:03:33,356 INFO [http-bio-7070-exec-10] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 09:03:33,357 INFO [http-bio-7070-exec-10] controller.QueryController:175 : The original query: select count(*) from streaming_sales_table 2016-08-15 09:03:33,359 INFO [http-bio-7070-exec-10] service.QueryService:266 : The corrected query: select count(*) from streaming_sales_table LIMIT 50000 2016-08-15 09:03:33,406 INFO [http-bio-7070-exec-10] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 09:03:33,407 INFO [http-bio-7070-exec-10] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@7821e81f 2016-08-15 09:03:33,407 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 09:03:33,407 INFO [http-bio-7070-exec-10] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 09:03:33,408 INFO [http-bio-7070-exec-10] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 09:03:33,471 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 09:03:33,471 INFO [http-bio-7070-exec-10] v2.CubeStorageQuery:222 : exactAggregation is false because cuboid 0=> 8 2016-08-15 09:03:33,472 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:03:33,472 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 09:03:33,472 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 51845474 for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:03:33,473 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 09:03:33,473 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:03:33,582 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:03:33,584 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:03:33,585 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 09:03:33,586 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 530d1767 for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:03:33,587 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 09:03:33,587 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:03:33,587 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:03:33,593 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:03:33,595 INFO [pool-6-thread-64] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 8. Total filtered/aggred row: 7. Time elapsed in EP: 2(ms). Server CPU usage: 0.06649336660108376, server physical mem left: 3.8047744E8, server swap mem left:3.694592E7.Etc message: start latency: 7@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,595 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 09:03:33,596 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 2e6d060 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:03:33,596 INFO [pool-6-thread-65] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 8. Total filtered/aggred row: 7. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.8047744E8, server swap mem left:3.694592E7.Etc message: start latency: 8@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,597 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 09:03:33,597 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:03:33,597 DEBUG [pool-6-thread-64] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 2 2016-08-15 09:03:33,597 INFO [pool-6-thread-66] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.80284928E8, server swap mem left:3.694592E7.Etc message: start latency: 5@1,agg done@2,compress done@2,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,598 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:03:33,605 DEBUG [pool-6-thread-65] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 8 2016-08-15 09:03:33,606 DEBUG [pool-6-thread-66] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 8 2016-08-15 09:03:33,607 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:03:33,607 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 09:03:33,607 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan e2197e6 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:03:33,608 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 09:03:33,608 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:03:33,608 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:03:33,615 INFO [pool-6-thread-67] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 1(ms). Server CPU usage: 0.25, server physical mem left: 3.801088E8, server swap mem left:3.6970496E7.Etc message: start latency: 19@0,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,615 DEBUG [pool-6-thread-67] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 09:03:33,618 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:03:33,619 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 264 bytes, rawScanBytesString 40 bytes 2016-08-15 09:03:33,626 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:315 : The scan 4fc2cdb9 for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:03:33,626 INFO [pool-6-thread-68] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.801088E8, server swap mem left:3.6990976E7.Etc message: start latency: 18@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,628 DEBUG [pool-6-thread-68] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 2 2016-08-15 09:03:33,637 INFO [http-bio-7070-exec-10] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid require post aggregation, from 0 to 8 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xFF\x00), No Fuzzy Key 2016-08-15 09:03:33,637 DEBUG [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:03:33,638 INFO [http-bio-7070-exec-10] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:03:33,639 DEBUG [http-bio-7070-exec-10] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 09:03:33,640 INFO [pool-6-thread-64] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 1(ms). Server CPU usage: 0.3333333333333333, server physical mem left: 3.801088E8, server swap mem left:3.6974592E7.Etc message: start latency: 18@0,agg done@1,compress done@1,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,640 INFO [pool-6-thread-66] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 2(ms). Server CPU usage: 0.4, server physical mem left: 3.79551744E8, server swap mem left:3.7015552E7.Etc message: start latency: 21@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,640 DEBUG [pool-6-thread-64] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 09:03:33,642 DEBUG [pool-6-thread-66] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 1 2016-08-15 09:03:33,643 INFO [pool-6-thread-69] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.79551744E8, server swap mem left:3.7015552E7.Etc message: start latency: 21@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,644 DEBUG [pool-6-thread-69] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 09:03:33,649 INFO [pool-6-thread-68] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 1(ms). Server CPU usage: 0.5, server physical mem left: 3.79265024E8, server swap mem left:3.715072E7.Etc message: start latency: 7@0,agg done@0,compress done@0,server stats done@1, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,649 DEBUG [pool-6-thread-68] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 09:03:33,650 INFO [pool-6-thread-70] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 4. Total filtered/aggred row: 3. Time elapsed in EP: 2(ms). Server CPU usage: 0.0, server physical mem left: 3.79265024E8, server swap mem left:3.715072E7.Etc message: start latency: 8@0,agg done@1,compress done@1,server stats done@2, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:03:33,650 DEBUG [pool-6-thread-70] util.CompressionUtils:67 : Original: 10 bytes. Decompressed: 2 bytes. Time: 0 2016-08-15 09:03:33,650 INFO [http-bio-7070-exec-10] service.QueryService:399 : Scan count for each storageContext: 5, 2016-08-15 09:03:33,651 INFO [http-bio-7070-exec-10] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 294, total scan count 5 2016-08-15 09:03:33,653 INFO [http-bio-7070-exec-10] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select count(*) from streaming_sales_table User: ADMIN Success: true Duration: 0.294 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [8] Total scan count: 5 Result row count: 1 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 09:04:28,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:05:28,012 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:06:06,595 INFO [http-bio-7070-exec-4] controller.QueryController:174 : Using project: Kafka_Streaming 2016-08-15 09:06:06,596 INFO [http-bio-7070-exec-4] controller.QueryController:175 : The original query: select * from streaming_sales_table 2016-08-15 09:06:06,597 INFO [http-bio-7070-exec-4] service.QueryService:266 : The corrected query: select * from streaming_sales_table LIMIT 50000 2016-08-15 09:06:06,647 INFO [http-bio-7070-exec-4] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@2faf5732 2016-08-15 09:06:06,647 INFO [http-bio-7070-exec-4] routing.QueryRouter:60 : Find candidates by table DEFAULT.STREAMING_SALES_TABLE and project=KAFKA_STREAMING : org.apache.kylin.query.routing.Candidate@6bda3d9c 2016-08-15 09:06:06,648 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 09:06:06,648 INFO [http-bio-7070-exec-4] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [Streaming_Cube(CUBE)], realizations after: [Streaming_Cube(CUBE)] 2016-08-15 09:06:06,648 INFO [http-bio-7070-exec-4] routing.QueryRouter:72 : The realizations remaining: [Streaming_Cube(CUBE)] And the final chosen one is the first one 2016-08-15 09:06:06,656 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:107 : query storage... 2016-08-15 09:06:06,657 INFO [http-bio-7070-exec-4] enumerator.OLAPEnumerator:181 : No group by and aggregation found in this query, will hack some result for better look of output... 2016-08-15 09:06:06,657 INFO [http-bio-7070-exec-4] v2.CubeStorageQuery:239 : exactAggregation is true 2016-08-15 09:06:06,657 INFO [http-bio-7070-exec-4] v2.CubeStorageQuery:357 : Enable limit 50000 2016-08-15 09:06:06,658 WARN [http-bio-7070-exec-4] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:06:06,659 WARN [http-bio-7070-exec-4] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:06:06,659 WARN [http-bio-7070-exec-4] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:06:06,659 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815045500_20160815050000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:06:06,660 WARN [http-bio-7070-exec-4] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:06:06,660 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1277 bytes, rawScanBytesString 68 bytes 2016-08-15 09:06:06,661 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 5ae9630e for segment Streaming_Cube[20160815045500_20160815050000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:06:06,661 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_O71JLBZAOY: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 09:06:06,662 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:06:06,663 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:06:06,665 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050000_20160815050500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:06:06,668 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 09:06:06,668 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 6bebdbcb for segment Streaming_Cube[20160815050000_20160815050500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:06:06,669 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RYLCSKWFA6: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 09:06:06,669 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:06:06,670 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:06:06,671 INFO [pool-6-thread-72] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 5(ms). Server CPU usage: 0.0, server physical mem left: 4.26868736E8, server swap mem left:4.6784512E7.Etc message: start latency: 2@3,agg done@4,compress done@4,server stats done@5, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,671 INFO [pool-6-thread-71] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_O71JLBZAOY Shard \x4B\x59\x4C\x49\x4E\x5F\x4F\x37\x31\x4A\x4C\x42\x5A\x41\x4F\x59\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x35\x30\x31\x32\x31\x37\x2E\x30\x65\x32\x32\x39\x62\x61\x62\x34\x63\x33\x34\x37\x37\x38\x35\x61\x62\x34\x64\x62\x62\x66\x37\x38\x31\x37\x31\x34\x35\x34\x33\x2E on host: sandbox.hortonworks.com.Total scanned row: 0. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.104850489414214, server physical mem left: 4.26868736E8, server swap mem left:4.6784512E7.Etc message: start latency: 2@2,agg done@2,compress done@2,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,671 DEBUG [pool-6-thread-72] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 0 2016-08-15 09:06:06,672 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815050500_20160815051000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:06:06,672 DEBUG [pool-6-thread-71] util.CompressionUtils:67 : Original: 8 bytes. Decompressed: 0 bytes. Time: 1 2016-08-15 09:06:06,673 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 09:06:06,673 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 10e81598 for segment Streaming_Cube[20160815050500_20160815051000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:06:06,674 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_QI5RHA2QG8: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 09:06:06,674 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:06:06,674 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:06:06,681 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051000_20160815051500] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:06:06,690 INFO [pool-6-thread-73] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 9(ms). Server CPU usage: 0.5, server physical mem left: 4.265984E8, server swap mem left:4.6821376E7.Etc message: start latency: 2@1,agg done@4,compress done@9,server stats done@9, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,690 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 09:06:06,691 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 400c3105 for segment Streaming_Cube[20160815051000_20160815051500] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:06:06,692 DEBUG [pool-6-thread-73] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 2 2016-08-15 09:06:06,692 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_6KDY71AMVZ: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 09:06:06,693 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:06:06,693 INFO [pool-6-thread-72] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.6666666666666666, server physical mem left: 4.26070016E8, server swap mem left:4.6841856E7.Etc message: start latency: 8@1,agg done@3,compress done@4,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,693 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:06:06,694 INFO [pool-6-thread-74] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RYLCSKWFA6 Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x59\x4C\x43\x53\x4B\x57\x46\x41\x36\x2C\x2C\x31\x34\x37\x31\x32\x33\x37\x38\x30\x37\x31\x36\x33\x2E\x37\x64\x34\x63\x34\x37\x62\x63\x64\x35\x33\x33\x62\x33\x38\x63\x30\x62\x33\x38\x37\x33\x37\x39\x63\x65\x39\x63\x64\x33\x37\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.0, server physical mem left: 4.25529344E8, server swap mem left:4.6866432E7.Etc message: start latency: 15@1,agg done@5,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,696 INFO [pool-6-thread-75] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_QI5RHA2QG8 Shard \x4B\x59\x4C\x49\x4E\x5F\x51\x49\x35\x52\x48\x41\x32\x51\x47\x38\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x31\x30\x37\x34\x33\x31\x2E\x37\x62\x34\x64\x30\x39\x31\x64\x35\x66\x34\x32\x61\x30\x39\x38\x66\x62\x37\x36\x36\x66\x64\x64\x33\x34\x37\x36\x36\x32\x66\x32\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 8(ms). Server CPU usage: 1.0, server physical mem left: 4.25529344E8, server swap mem left:4.6895104E7.Etc message: start latency: 10@0,agg done@3,compress done@8,server stats done@8, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,696 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:257 : New scanner for current segment Streaming_Cube[20160815051500_20160815052000] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-15 09:06:06,698 DEBUG [pool-6-thread-72] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 4 2016-08-15 09:06:06,707 DEBUG [pool-6-thread-75] util.CompressionUtils:67 : Original: 1584 bytes. Decompressed: 3748 bytes. Time: 11 2016-08-15 09:06:06,707 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:313 : Serialized scanRequestBytes 1282 bytes, rawScanBytesString 76 bytes 2016-08-15 09:06:06,708 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:315 : The scan 181786a for segment Streaming_Cube[20160815051500_20160815052000] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-15 09:06:06,708 INFO [http-bio-7070-exec-4] v2.CubeHBaseRPC:271 : Visiting hbase table KYLIN_RQBYOKVTHM: cuboid exact match, from 255 to 255 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-15 09:06:06,708 DEBUG [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:320 : Submitting rpc to 1 shards starting from shard 0, scan range count 1 2016-08-15 09:06:06,709 INFO [http-bio-7070-exec-4] v2.CubeHBaseEndpointRPC:103 : Timeout for ExpectedSizeIterator is: 99000 2016-08-15 09:06:06,716 DEBUG [pool-6-thread-74] util.CompressionUtils:67 : Original: 1567 bytes. Decompressed: 3724 bytes. Time: 20 2016-08-15 09:06:06,730 INFO [pool-6-thread-73] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 3(ms). Server CPU usage: 0.25, server physical mem left: 4.24845312E8, server swap mem left:4.698112E7.Etc message: start latency: 21@1,agg done@3,compress done@3,server stats done@3, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,724 DEBUG [http-bio-7070-exec-4] enumerator.OLAPEnumerator:127 : return TupleIterator... 2016-08-15 09:06:06,730 INFO [pool-6-thread-76] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_6KDY71AMVZ Shard \x4B\x59\x4C\x49\x4E\x5F\x36\x4B\x44\x59\x37\x31\x41\x4D\x56\x5A\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x34\x30\x37\x38\x38\x36\x2E\x66\x31\x39\x63\x34\x35\x36\x30\x31\x30\x36\x33\x64\x61\x66\x33\x31\x32\x65\x39\x65\x37\x38\x31\x34\x62\x63\x31\x63\x62\x37\x34\x2E on host: sandbox.hortonworks.com.Total scanned row: 150. Total filtered/aggred row: 0. Time elapsed in EP: 4(ms). Server CPU usage: 0.0, server physical mem left: 4.24845312E8, server swap mem left:4.698112E7.Etc message: start latency: 22@0,agg done@3,compress done@3,server stats done@4, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,731 DEBUG [pool-6-thread-73] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 1 2016-08-15 09:06:06,732 DEBUG [pool-6-thread-76] util.CompressionUtils:67 : Original: 1572 bytes. Decompressed: 3746 bytes. Time: 2 2016-08-15 09:06:06,747 INFO [pool-6-thread-77] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 6(ms). Server CPU usage: 0.4, server physical mem left: 4.2459136E8, server swap mem left:4.708352E7.Etc message: start latency: 23@1,agg done@4,compress done@6,server stats done@6, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,748 DEBUG [pool-6-thread-77] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 1 2016-08-15 09:06:06,752 INFO [pool-6-thread-72] v2.CubeHBaseEndpointRPC:351 : Endpoint RPC returned from HTable KYLIN_RQBYOKVTHM Shard \x4B\x59\x4C\x49\x4E\x5F\x52\x51\x42\x59\x4F\x4B\x56\x54\x48\x4D\x2C\x2C\x31\x34\x37\x31\x32\x33\x38\x37\x30\x36\x31\x37\x33\x2E\x30\x64\x62\x66\x38\x37\x31\x61\x64\x38\x34\x35\x39\x61\x35\x63\x61\x66\x61\x34\x33\x39\x33\x36\x37\x30\x63\x34\x30\x65\x33\x63\x2E on host: sandbox.hortonworks.com.Total scanned row: 149. Total filtered/aggred row: 0. Time elapsed in EP: 7(ms). Server CPU usage: 0.5, server physical mem left: 4.24321024E8, server swap mem left:4.7095808E7.Etc message: start latency: 30@1,agg done@3,compress done@7,server stats done@7, debugGitTag:cf4d2940b67d622eacd2ac9a913b221091a35c2e;.Normal Complete: true. 2016-08-15 09:06:06,753 DEBUG [pool-6-thread-72] util.CompressionUtils:67 : Original: 1578 bytes. Decompressed: 3723 bytes. Time: 1 2016-08-15 09:06:06,772 INFO [http-bio-7070-exec-4] service.QueryService:399 : Scan count for each storageContext: 598, 2016-08-15 09:06:06,773 INFO [http-bio-7070-exec-4] controller.QueryController:197 : Stats of SQL response: isException: false, duration: 176, total scan count 598 2016-08-15 09:06:06,773 INFO [http-bio-7070-exec-4] service.QueryService:250 : ==========================[QUERY]=============================== SQL: select * from streaming_sales_table User: ADMIN Success: true Duration: 0.176 Project: Kafka_Streaming Realization Names: [Streaming_Cube] Cuboid Ids: [255] Total scan count: 598 Result row count: 598 Accept Partial: true Is Partial Result: false Hit Exception Cache: false Storage cache used: false Message: null ==========================[QUERY]=============================== 2016-08-15 09:06:28,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:07:27,990 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:08:27,989 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:09:28,000 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:10:28,034 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:11:28,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:12:28,020 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:13:28,006 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:14:28,016 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:15:28,134 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:16:28,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:17:28,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:18:28,013 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:19:27,998 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:20:28,230 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:21:28,008 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:22:28,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:23:28,022 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:24:28,181 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:25:28,030 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:26:27,996 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:27:27,989 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:28:28,000 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:29:27,983 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:30:27,989 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:31:27,997 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:32:28,000 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:33:28,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:34:28,149 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:35:28,009 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:36:06,839 DEBUG [http-bio-7070-exec-7] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 09:36:28,025 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:37:28,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:38:28,080 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:39:28,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:40:28,047 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:41:28,006 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:42:28,026 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:43:02,229 INFO [http-bio-7070-exec-1] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:02,303 INFO [http-bio-7070-exec-1] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:02,555 DEBUG [http-bio-7070-exec-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 6 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_F3G3LU57KA 2016-08-15 09:43:02,575 INFO [http-bio-7070-exec-1] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:02,578 INFO [http-bio-7070-exec-1] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:02,676 DEBUG [http-bio-7070-exec-1] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:02,678 DEBUG [http-bio-7070-exec-1] service.CubeService:591 : server mode: all 2016-08-15 09:43:02,680 INFO [http-bio-7070-exec-1] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:02,685 DEBUG [http-bio-7070-exec-1] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:12,131 INFO [http-bio-7070-exec-5] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:12,178 INFO [http-bio-7070-exec-5] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:12,473 DEBUG [http-bio-7070-exec-5] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 7 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_AV1FSW1TI1,KYLIN_F3G3LU57KA 2016-08-15 09:43:13,019 INFO [http-bio-7070-exec-5] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:13,020 INFO [http-bio-7070-exec-5] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:13,031 DEBUG [http-bio-7070-exec-5] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:13,116 DEBUG [http-bio-7070-exec-5] service.CubeService:591 : server mode: all 2016-08-15 09:43:13,117 INFO [http-bio-7070-exec-5] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:13,119 DEBUG [http-bio-7070-exec-5] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:21,447 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:21,447 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:21,512 DEBUG [http-bio-7070-exec-8] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 8 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:21,536 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:21,537 INFO [http-bio-7070-exec-8] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:21,537 DEBUG [http-bio-7070-exec-8] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:21,537 DEBUG [http-bio-7070-exec-8] service.CubeService:591 : server mode: all 2016-08-15 09:43:21,537 INFO [http-bio-7070-exec-8] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:21,538 DEBUG [http-bio-7070-exec-8] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:21,615 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:21,616 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:21,638 DEBUG [http-bio-7070-exec-8] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 8 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:21,644 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:21,650 INFO [http-bio-7070-exec-8] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:21,651 DEBUG [http-bio-7070-exec-8] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:21,651 DEBUG [http-bio-7070-exec-8] service.CubeService:591 : server mode: all 2016-08-15 09:43:21,680 INFO [http-bio-7070-exec-8] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:21,680 DEBUG [http-bio-7070-exec-8] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:25,679 INFO [http-bio-7070-exec-4] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:25,680 INFO [http-bio-7070-exec-4] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:25,685 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 11 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:25,691 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:25,692 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:25,692 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:25,693 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 09:43:25,694 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:25,694 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:25,728 INFO [http-bio-7070-exec-4] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:25,729 INFO [http-bio-7070-exec-4] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:25,734 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 11 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:25,738 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:25,739 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:25,739 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:25,740 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 09:43:25,740 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:25,741 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:28,269 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 45 others 2016-08-15 09:43:28,637 INFO [http-bio-7070-exec-3] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:28,638 INFO [http-bio-7070-exec-3] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:28,655 DEBUG [http-bio-7070-exec-3] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:28,662 INFO [http-bio-7070-exec-3] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:28,663 INFO [http-bio-7070-exec-3] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:28,663 DEBUG [http-bio-7070-exec-3] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:28,663 DEBUG [http-bio-7070-exec-3] service.CubeService:591 : server mode: all 2016-08-15 09:43:28,663 INFO [http-bio-7070-exec-3] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:28,664 DEBUG [http-bio-7070-exec-3] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:28,736 INFO [http-bio-7070-exec-10] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:28,736 INFO [http-bio-7070-exec-10] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:28,744 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:28,748 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:28,749 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:28,754 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:28,754 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 09:43:28,755 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:28,756 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:29,563 INFO [http-bio-7070-exec-11] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:29,563 INFO [http-bio-7070-exec-11] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:29,572 DEBUG [http-bio-7070-exec-11] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 13 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:29,576 INFO [http-bio-7070-exec-11] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:29,577 INFO [http-bio-7070-exec-11] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:29,577 DEBUG [http-bio-7070-exec-11] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:29,578 DEBUG [http-bio-7070-exec-11] service.CubeService:591 : server mode: all 2016-08-15 09:43:29,578 INFO [http-bio-7070-exec-11] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:29,578 DEBUG [http-bio-7070-exec-11] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:29,664 INFO [http-bio-7070-exec-11] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:29,664 INFO [http-bio-7070-exec-11] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:29,677 DEBUG [http-bio-7070-exec-11] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 13 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:29,690 INFO [http-bio-7070-exec-11] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:29,692 INFO [http-bio-7070-exec-11] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:29,693 DEBUG [http-bio-7070-exec-11] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:29,697 DEBUG [http-bio-7070-exec-11] service.CubeService:591 : server mode: all 2016-08-15 09:43:29,698 INFO [http-bio-7070-exec-11] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:29,698 DEBUG [http-bio-7070-exec-11] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:30,225 INFO [http-bio-7070-exec-2] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:30,225 INFO [http-bio-7070-exec-2] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:30,235 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 14 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_LCYIKZ5ADM,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:30,249 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:30,250 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:30,250 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:30,252 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 09:43:30,253 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:30,266 INFO [http-bio-7070-exec-2] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:43:30,549 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254209755, to newTs: 1471254210269, operation result: true 2016-08-15 09:43:30,562 DEBUG [http-bio-7070-exec-2] restclient.Broadcaster:88 : 1 nodes in the cluster: [localhost:7070] 2016-08-15 09:43:30,589 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 15 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:30,593 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:30,593 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:30,594 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:30,595 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 09:43:30,595 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:30,595 DEBUG [http-bio-7070-exec-2] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:43:30,596 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:30,596 DEBUG [http-bio-7070-exec-2] service.CubeService:646 : Will submit merge job on Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:43:30,675 INFO [http-bio-7070-exec-2] mr.BatchMergeJobBuilder2:48 : MR_V2 new job to MERGE segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:43:30,701 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:43:30,830 INFO [http-bio-7070-exec-2] engine.JobEngineConfig:96 : Chosen job conf is : /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml 2016-08-15 09:43:30,847 INFO [http-bio-7070-exec-2] engine.JobEngineConfig:96 : Chosen job conf is : /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml 2016-08-15 09:43:30,880 INFO [http-bio-7070-exec-7] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:30,880 INFO [http-bio-7070-exec-7] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:30,888 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 16 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:30,892 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:30,893 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:30,894 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:30,894 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 09:43:30,894 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:30,920 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 0, to newTs: 1471254210884, operation result: true 2016-08-15 09:43:30,940 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 0, to newTs: 1471254210929, operation result: true 2016-08-15 09:43:30,946 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-00 from oldTs: 0, to newTs: 1471254210941, operation result: true 2016-08-15 09:43:30,951 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-01 from oldTs: 0, to newTs: 1471254210947, operation result: true 2016-08-15 09:43:30,960 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-02 from oldTs: 0, to newTs: 1471254210951, operation result: true 2016-08-15 09:43:30,964 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 0, to newTs: 1471254210960, operation result: true 2016-08-15 09:43:30,969 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 0, to newTs: 1471254210965, operation result: true 2016-08-15 09:43:30,973 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-05 from oldTs: 0, to newTs: 1471254210970, operation result: true 2016-08-15 09:43:30,979 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-06 from oldTs: 0, to newTs: 1471254210974, operation result: true 2016-08-15 09:43:30,986 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-07 from oldTs: 0, to newTs: 1471254210982, operation result: true 2016-08-15 09:43:30,994 DEBUG [http-bio-7070-exec-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-08 from oldTs: 0, to newTs: 1471254210987, operation result: true 2016-08-15 09:43:30,995 DEBUG [http-bio-7070-exec-7] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:43:30,995 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:31,015 INFO [http-bio-7070-exec-4] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:31,016 INFO [http-bio-7070-exec-4] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:31,021 DEBUG [http-bio-7070-exec-4] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 16 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:31,024 INFO [http-bio-7070-exec-4] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:31,025 INFO [http-bio-7070-exec-4] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:31,026 DEBUG [http-bio-7070-exec-4] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:31,026 DEBUG [http-bio-7070-exec-4] service.CubeService:591 : server mode: all 2016-08-15 09:43:31,026 INFO [http-bio-7070-exec-4] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:31,027 DEBUG [http-bio-7070-exec-4] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:43:31,027 DEBUG [http-bio-7070-exec-4] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:43:33,714 INFO [http-bio-7070-exec-5] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:43:33,715 INFO [http-bio-7070-exec-5] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:43:33,729 DEBUG [http-bio-7070-exec-5] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 17 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:43:33,736 INFO [http-bio-7070-exec-5] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:43:33,736 INFO [http-bio-7070-exec-5] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:43:33,737 DEBUG [http-bio-7070-exec-5] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:43:33,738 DEBUG [http-bio-7070-exec-5] service.CubeService:591 : server mode: all 2016-08-15 09:43:33,738 INFO [http-bio-7070-exec-5] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:43:33,738 DEBUG [http-bio-7070-exec-5] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:43:33,739 DEBUG [http-bio-7070-exec-5] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:44:28,021 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:44:28,024 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:44:28,028 INFO [pool-5-thread-1] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:44:28,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:44:28,065 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254210929, to newTs: 1471254268049, operation result: true 2016-08-15 09:44:28,066 INFO [pool-5-thread-1] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:44:28,071 INFO [pool-5-thread-1] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Merge Cuboid Dictionary <<<<<<<<<<<<< 2016-08-15 09:44:28,087 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-00 from oldTs: 1471254210941, to newTs: 1471254268082, operation result: true 2016-08-15 09:44:28,087 INFO [pool-5-thread-1] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-00 from READY to RUNNING 2016-08-15 09:44:28,092 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.MINUTE_START 2016-08-15 09:44:28,093 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,095 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.DAY_START 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,098 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,099 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,099 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,099 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,099 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,099 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.COUNTRY 2016-08-15 09:44:28,099 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,100 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,100 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,102 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,102 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,103 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.HOUR_START 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,104 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.DEVICE 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.CURRENCY 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,105 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.CATEGORY 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815071000] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071000_20160815071500] 2016-08-15 09:44:28,106 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815071500_20160815072000] 2016-08-15 09:44:28,107 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072000_20160815072500] 2016-08-15 09:44:28,107 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815072500_20160815073000] 2016-08-15 09:44:28,107 INFO [pool-5-thread-1] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815073000_20160815073500] 2016-08-15 09:44:28,107 INFO [pool-5-thread-1] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:44:28,116 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254213404, to newTs: 1471254268107, operation result: true 2016-08-15 09:44:28,117 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:44:28,124 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:44:28,124 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:44:28,125 DEBUG [pool-5-thread-1] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 17 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:44:28,129 INFO [pool-5-thread-1] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:44:28,129 INFO [pool-5-thread-1] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:44:28,129 DEBUG [pool-5-thread-1] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:44:28,129 DEBUG [pool-5-thread-1] service.CubeService:591 : server mode: all 2016-08-15 09:44:28,129 INFO [pool-5-thread-1] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:44:28,129 DEBUG [pool-5-thread-1] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:44:28,129 DEBUG [pool-5-thread-1] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:44:28,139 DEBUG [http-bio-7070-exec-8] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 17 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:44:28,142 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:44:28,142 INFO [http-bio-7070-exec-8] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:44:28,143 DEBUG [http-bio-7070-exec-8] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:44:28,143 DEBUG [http-bio-7070-exec-8] service.CubeService:591 : server mode: all 2016-08-15 09:44:28,144 INFO [http-bio-7070-exec-8] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:44:28,144 DEBUG [http-bio-7070-exec-8] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:44:28,145 DEBUG [http-bio-7070-exec-8] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:44:28,147 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-00 from oldTs: 1471254268082, to newTs: 1471254268142, operation result: true 2016-08-15 09:44:28,156 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-00 from oldTs: 1471254268142, to newTs: 1471254268152, operation result: true 2016-08-15 09:44:28,156 INFO [pool-5-thread-1] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-00 from RUNNING to SUCCEED 2016-08-15 09:44:28,167 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254268049, to newTs: 1471254268163, operation result: true 2016-08-15 09:44:28,194 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254268163, to newTs: 1471254268189, operation result: true 2016-08-15 09:44:28,194 INFO [pool-5-thread-1] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:44:28,337 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:44:28,338 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:44:28,338 INFO [pool-5-thread-2] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:44:28,343 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:44:28,347 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254268189, to newTs: 1471254268343, operation result: true 2016-08-15 09:44:28,347 INFO [pool-5-thread-2] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:44:28,353 INFO [pool-5-thread-2] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Merge Cuboid Statistics <<<<<<<<<<<<< 2016-08-15 09:44:28,360 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-01 from oldTs: 1471254210947, to newTs: 1471254268356, operation result: true 2016-08-15 09:44:28,361 INFO [pool-5-thread-2] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-01 from READY to RUNNING 2016-08-15 09:44:30,301 DEBUG [pool-5-thread-2] persistence.ResourceStore:209 : Directly saving resource /cube_statistics/Streaming_Cube/2d1f13ec-0f28-45f2-b693-7abfaff0177c.seq (Store kylin_metadata@hbase) 2016-08-15 09:44:30,518 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-01 from oldTs: 1471254268356, to newTs: 1471254270514, operation result: true 2016-08-15 09:44:30,528 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-01 from oldTs: 1471254270514, to newTs: 1471254270524, operation result: true 2016-08-15 09:44:30,528 INFO [pool-5-thread-2] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-01 from RUNNING to SUCCEED 2016-08-15 09:44:30,540 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254268343, to newTs: 1471254270536, operation result: true 2016-08-15 09:44:30,563 DEBUG [pool-5-thread-2] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254270536, to newTs: 1471254270560, operation result: true 2016-08-15 09:44:30,563 INFO [pool-5-thread-2] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:44:30,665 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:44:30,666 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:44:30,666 INFO [pool-5-thread-3] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:44:30,670 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:44:30,676 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254270560, to newTs: 1471254270671, operation result: true 2016-08-15 09:44:30,676 INFO [pool-5-thread-3] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:44:30,683 INFO [pool-5-thread-3] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Create HTable <<<<<<<<<<<<< 2016-08-15 09:44:30,689 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-02 from oldTs: 1471254210951, to newTs: 1471254270685, operation result: true 2016-08-15 09:44:30,689 INFO [pool-5-thread-3] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-02 from READY to RUNNING 2016-08-15 09:44:30,744 INFO [pool-5-thread-3] execution.AbstractExecutable:55 : parameters of the HadoopShellExecutable: 2016-08-15 09:44:30,744 INFO [pool-5-thread-3] execution.AbstractExecutable:56 : -cubename Streaming_Cube -segmentname 20160815070500_20160815073500 -partitions hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/rowkey_stats/part-r-00000 -statisticsenabled true 2016-08-15 09:44:30,896 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.MINUTE_START, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.CATEGORY, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.CURRENCY, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.COUNTRY, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.DEVICE, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.DAY_START, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.HOUR_START, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,897 WARN [pool-5-thread-3] kv.CubeDimEncMap:68 : No dictionary found for dict-encoding column DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME, segment Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:44:30,898 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 136 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 32 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 168 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 64 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 200 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,899 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 96 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 232 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 8 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 128 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 40 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 160 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 72 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,900 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 192 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 104 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 224 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 152 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 255 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 16 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 184 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 48 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,901 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 216 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 80 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 248 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 112 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 144 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 24 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 176 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,902 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 56 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 208 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 88 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 240 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] common.CubeStatsReader:213 : Cuboid 120 has 0 rows, each row size is 28 bytes. Total size is 0.0M. 2016-08-15 09:44:30,903 INFO [pool-5-thread-3] steps.CreateHTableJob:166 : Cut for HBase region is 5.0GB 2016-08-15 09:44:30,905 INFO [pool-5-thread-3] steps.CreateHTableJob:197 : Region count is adjusted from 1 to 2 to help random sharding 2016-08-15 09:44:30,905 INFO [pool-5-thread-3] steps.CreateHTableJob:204 : Total size 0.0M (estimated) 2016-08-15 09:44:30,905 INFO [pool-5-thread-3] steps.CreateHTableJob:205 : Expecting 2 regions. 2016-08-15 09:44:30,905 INFO [pool-5-thread-3] steps.CreateHTableJob:206 : Expecting 1 MB per region. 2016-08-15 09:44:30,911 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 8 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,920 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 16 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,920 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 24 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,920 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 32 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,920 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 40 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,920 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 48 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,921 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 56 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,921 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 64 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,921 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 72 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,921 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 80 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,921 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 88 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,921 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 96 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 104 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 112 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 120 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 128 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 136 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 144 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 152 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 160 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,922 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 168 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 176 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 184 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 192 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 200 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 208 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 216 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 224 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,923 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 232 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,924 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 240 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,924 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 248 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,924 INFO [pool-5-thread-3] steps.CreateHTableJob:230 : Cuboid 255 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:44:30,924 INFO [pool-5-thread-3] steps.CreateHTableJob:243 : Region 0's estimated size is 0.00 MB, accounting for NaN percent 2016-08-15 09:44:30,924 INFO [pool-5-thread-3] steps.CreateHTableJob:243 : Region 1's estimated size is 0.00 MB, accounting for NaN percent 2016-08-15 09:44:30,926 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 136 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 64 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 200 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 8 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 128 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 72 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 192 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 152 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 16 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,927 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 216 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 80 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 144 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 24 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 208 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 88 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 32 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 168 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 96 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 232 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 40 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 160 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 104 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 224 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 255 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 184 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 48 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,928 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 248 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,929 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 112 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,929 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 176 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,929 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 56 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,929 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 240 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,929 INFO [pool-5-thread-3] common.CuboidShardUtil:42 : Cuboid 120 has 1 shards, skip saving it as an optimization 2016-08-15 09:44:30,929 INFO [pool-5-thread-3] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:44:30,936 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254268107, to newTs: 1471254270929, operation result: true 2016-08-15 09:44:30,936 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:44:30,939 DEBUG [pool-5-thread-3] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 17 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:44:30,941 INFO [pool-5-thread-3] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:44:30,942 INFO [pool-5-thread-3] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:44:30,943 DEBUG [pool-5-thread-3] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:44:30,943 DEBUG [pool-5-thread-3] service.CubeService:591 : server mode: all 2016-08-15 09:44:30,943 INFO [pool-5-thread-3] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:44:30,944 DEBUG [pool-5-thread-3] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:44:30,944 DEBUG [pool-5-thread-3] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:44:30,944 INFO [http-bio-7070-exec-11] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:44:30,945 INFO [http-bio-7070-exec-11] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:44:30,949 DEBUG [http-bio-7070-exec-11] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 17 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_LCYIKZ5ADM,KYLIN_6I0AODXTI4,KYLIN_462LVA085U,KYLIN_LOOYD7D3MW,KYLIN_AV1FSW1TI1,KYLIN_N3F0URAEYE,KYLIN_F3G3LU57KA 2016-08-15 09:44:30,951 INFO [http-bio-7070-exec-11] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:44:30,951 INFO [http-bio-7070-exec-11] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:44:30,952 DEBUG [http-bio-7070-exec-11] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:44:30,952 DEBUG [http-bio-7070-exec-11] service.CubeService:591 : server mode: all 2016-08-15 09:44:30,953 INFO [http-bio-7070-exec-11] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:44:30,953 DEBUG [http-bio-7070-exec-11] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:44:30,953 DEBUG [http-bio-7070-exec-11] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:44:30,969 INFO [pool-5-thread-3] steps.CreateHTableJob:303 : hbase.hstore.compactionThreshold is 3 2016-08-15 09:44:30,969 INFO [pool-5-thread-3] steps.CreateHTableJob:311 : hfileSizeMB:1.0 2016-08-15 09:44:31,370 INFO [pool-5-thread-3] steps.CubeHTableUtil:167 : hbase will use snappy to compress data 2016-08-15 09:44:31,403 INFO [pool-5-thread-3] util.DeployCoprocessorCLI:189 : Add coprocessor on KYLIN_6I0AODXTI4 2016-08-15 09:44:31,404 INFO [pool-5-thread-3] util.DeployCoprocessorCLI:169 : hbase table KYLIN_6I0AODXTI4 deployed with coprocessor. 2016-08-15 09:44:34,589 INFO [pool-5-thread-3] steps.CubeHTableUtil:107 : create hbase table KYLIN_6I0AODXTI4 done. 2016-08-15 09:44:34,598 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-02 from oldTs: 1471254270685, to newTs: 1471254274594, operation result: true 2016-08-15 09:44:34,607 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-02 from oldTs: 1471254274594, to newTs: 1471254274603, operation result: true 2016-08-15 09:44:34,607 INFO [pool-5-thread-3] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-02 from RUNNING to SUCCEED 2016-08-15 09:44:34,621 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254270671, to newTs: 1471254274616, operation result: true 2016-08-15 09:44:34,647 DEBUG [pool-5-thread-3] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254274616, to newTs: 1471254274643, operation result: true 2016-08-15 09:44:34,647 INFO [pool-5-thread-3] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:44:34,755 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:44:34,755 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:44:34,755 INFO [pool-5-thread-4] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:44:34,760 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:44:34,764 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254274643, to newTs: 1471254274760, operation result: true 2016-08-15 09:44:34,764 INFO [pool-5-thread-4] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:44:34,776 INFO [pool-5-thread-4] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Merge Cuboid Data <<<<<<<<<<<<< 2016-08-15 09:44:34,785 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254210960, to newTs: 1471254274781, operation result: true 2016-08-15 09:44:34,785 INFO [pool-5-thread-4] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from READY to RUNNING 2016-08-15 09:44:34,905 INFO [pool-5-thread-4] execution.AbstractExecutable:113 : parameters of the MapReduceExecutable: 2016-08-15 09:44:34,906 INFO [pool-5-thread-4] execution.AbstractExecutable:114 : -conf /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml -cubename Streaming_Cube -segmentname 20160815070500_20160815073500 -input /kylin/kylin_metadata/kylin-6bdc957a-0946-4e99-91af-73fe2d12d115/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-f6b0b56b-6d9a-40c0-8ccf-35e0a8bc654d/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-49bb7b3a-6fa0-4209-9474-e327d2f6ff32/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-788ddf0e-ee45-4c1c-8398-4cde29fc9311/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-1c1b5793-953a-4b0f-9721-1fcca1b95d2f/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-43cbe4e3-d756-406e-90d7-b0d343270339/Streaming_Cube/cuboid/* -output /kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/cuboid/ -jobname Kylin_Merge_Cuboid_Streaming_Cube_Step 2016-08-15 09:44:34,951 INFO [pool-5-thread-4] steps.CuboidJob:56 : Starting: Kylin_Merge_Cuboid_Streaming_Cube_Step 2016-08-15 09:44:34,964 INFO [pool-5-thread-4] common.AbstractHadoopJob:161 : append job jar: /root/apache-kylin-1.5.2.1/bin/../lib/kylin-job-1.5.2.1.jar 2016-08-15 09:44:34,964 INFO [pool-5-thread-4] common.AbstractHadoopJob:168 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-08-15 09:44:34,965 INFO [pool-5-thread-4] common.AbstractHadoopJob:185 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-08-15 09:44:34,965 INFO [pool-5-thread-4] common.AbstractHadoopJob:197 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:44:34,984 INFO [pool-5-thread-4] common.AbstractHadoopJob:199 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:44:34,985 INFO [pool-5-thread-4] common.AbstractHadoopJob:336 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:44:34,988 DEBUG [pool-5-thread-4] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-6bdc957a-0946-4e99-91af-73fe2d12d115/Streaming_Cube/cuboid 2016-08-15 09:44:35,001 DEBUG [pool-5-thread-4] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-f6b0b56b-6d9a-40c0-8ccf-35e0a8bc654d/Streaming_Cube/cuboid 2016-08-15 09:44:35,003 DEBUG [pool-5-thread-4] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-49bb7b3a-6fa0-4209-9474-e327d2f6ff32/Streaming_Cube/cuboid 2016-08-15 09:44:35,005 DEBUG [pool-5-thread-4] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-788ddf0e-ee45-4c1c-8398-4cde29fc9311/Streaming_Cube/cuboid 2016-08-15 09:44:35,007 DEBUG [pool-5-thread-4] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-1c1b5793-953a-4b0f-9721-1fcca1b95d2f/Streaming_Cube/cuboid 2016-08-15 09:44:35,009 DEBUG [pool-5-thread-4] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-43cbe4e3-d756-406e-90d7-b0d343270339/Streaming_Cube/cuboid 2016-08-15 09:44:35,021 INFO [pool-5-thread-4] common.KylinConfig:118 : The URI /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta is recognized as LOCAL_FOLDER 2016-08-15 09:44:35,022 INFO [pool-5-thread-4] common.KylinConfigBase:110 : Kylin Config was updated with kylin.metadata.url : /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta 2016-08-15 09:44:35,022 INFO [pool-5-thread-4] persistence.ResourceStore:82 : Using metadata url /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta for resource store 2016-08-15 09:44:35,025 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /cube/Streaming_Cube.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,028 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /model_desc/Streaming_Model.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,030 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /cube_desc/Streaming_Cube.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,033 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /table/DEFAULT.STREAMING_SALES_TABLE.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,035 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,037 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,039 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,042 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,044 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,045 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,048 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,050 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,052 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,054 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,056 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,058 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,060 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,062 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,065 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,067 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,069 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,072 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,074 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,076 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,078 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,080 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,083 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,085 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,087 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,089 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,092 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,094 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,097 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,100 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,103 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,105 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,109 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,111 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,114 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,117 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,119 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,121 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,124 DEBUG [pool-5-thread-4] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta) 2016-08-15 09:44:35,124 INFO [pool-5-thread-4] common.AbstractHadoopJob:472 : HDFS meta dir is: file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta 2016-08-15 09:44:35,124 INFO [pool-5-thread-4] common.AbstractHadoopJob:350 : Job 'tmpfiles' updated -- file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta 2016-08-15 09:44:35,184 INFO [pool-5-thread-4] steps.CuboidJob:213 : Having total map input MB 0 2016-08-15 09:44:35,185 INFO [pool-5-thread-4] steps.CuboidJob:214 : Having level 0, pre-level cuboids 1, this level cuboids 1 2016-08-15 09:44:35,185 INFO [pool-5-thread-4] steps.CuboidJob:215 : Having per reduce MB 500.0, reduce count ratio 1.0 2016-08-15 09:44:35,185 INFO [pool-5-thread-4] steps.CuboidJob:216 : Setting mapred.reduce.tasks=1 2016-08-15 09:44:39,089 INFO [pool-5-thread-4] common.AbstractHadoopJob:479 : tempMetaFileString is : file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta2358841070124100989/meta 2016-08-15 09:44:39,103 INFO [pool-5-thread-4] execution.AbstractExecutable:221 : kylin.job.yarn.app.rest.check.status.url is not set, read from job configuration 2016-08-15 09:44:39,104 INFO [pool-5-thread-4] execution.AbstractExecutable:237 : yarn.resourcemanager.webapp.address:http://sandbox.hortonworks.com:8088 2016-08-15 09:44:39,312 WARN [pool-5-thread-4] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:44:39,313 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:209 : Job job_1471242907167_0040 get status check result. 2016-08-15 09:44:39,313 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0040 status : {"app":{"id":"application_1471242907167_0040","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"ACCEPTED","finalStatus":"UNDEFINED","progress":0.0,"trackingUI":"UNASSIGNED","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254278756,"finishedTime":0,"elapsedTime":524,"allocatedMB":0,"allocatedVCores":0,"runningContainers":0,"memorySeconds":0,"vcoreSeconds":0,"queueUsagePercentage":0.0,"clusterUsagePercentage":0.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":1,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:44:39,405 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0040:ACCEPTED-UNDEFINED 2016-08-15 09:44:39,428 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254274781, to newTs: 1471254279412, operation result: true 2016-08-15 09:44:49,442 WARN [pool-5-thread-4] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:44:49,442 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:209 : Job job_1471242907167_0040 get status check result. 2016-08-15 09:44:49,442 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0040 status : {"app":{"id":"application_1471242907167_0040","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":5.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0040/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254278756,"finishedTime":0,"elapsedTime":10678,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0040_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":1750,"allocatedVCores":7,"runningContainers":7,"memorySeconds":3861,"vcoreSeconds":9,"queueUsagePercentage":77.77778,"clusterUsagePercentage":77.77778,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:44:49,443 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0040:RUNNING-UNDEFINED 2016-08-15 09:44:49,452 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254279412, to newTs: 1471254289447, operation result: true 2016-08-15 09:44:49,458 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254289447, to newTs: 1471254289454, operation result: true 2016-08-15 09:44:59,475 WARN [pool-5-thread-4] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:44:59,475 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:209 : Job job_1471242907167_0040 get status check result. 2016-08-15 09:44:59,475 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0040 status : {"app":{"id":"application_1471242907167_0040","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":5.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0040/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254278756,"finishedTime":0,"elapsedTime":20715,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0040_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":1750,"allocatedVCores":7,"runningContainers":7,"memorySeconds":21417,"vcoreSeconds":79,"queueUsagePercentage":77.77778,"clusterUsagePercentage":77.77778,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:44:59,476 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0040:RUNNING-UNDEFINED 2016-08-15 09:44:59,496 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254289454, to newTs: 1471254299479, operation result: true 2016-08-15 09:45:09,508 WARN [pool-5-thread-4] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:45:09,509 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:209 : Job job_1471242907167_0040 get status check result. 2016-08-15 09:45:09,509 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0040 status : {"app":{"id":"application_1471242907167_0040","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":50.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0040/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254278756,"finishedTime":0,"elapsedTime":30747,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0040_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":500,"allocatedVCores":2,"runningContainers":2,"memorySeconds":34849,"vcoreSeconds":136,"queueUsagePercentage":22.222223,"clusterUsagePercentage":22.222223,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:45:09,510 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0040:RUNNING-UNDEFINED 2016-08-15 09:45:09,521 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254299479, to newTs: 1471254309514, operation result: true 2016-08-15 09:45:19,534 WARN [pool-5-thread-4] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:45:19,534 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:209 : Job job_1471242907167_0040 get status check result. 2016-08-15 09:45:19,534 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0040 status : {"app":{"id":"application_1471242907167_0040","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"FINISHED","finalStatus":"SUCCEEDED","progress":100.0,"trackingUI":"History","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0040/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254278756,"finishedTime":1471254314736,"elapsedTime":35980,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0040_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":250,"allocatedVCores":1,"runningContainers":1,"memorySeconds":38799,"vcoreSeconds":152,"queueUsagePercentage":11.111112,"clusterUsagePercentage":11.111112,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:45:19,535 DEBUG [pool-5-thread-4] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0040:FINISHED-SUCCEEDED 2016-08-15 09:45:19,548 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254309514, to newTs: 1471254319539, operation result: true 2016-08-15 09:45:21,138 DEBUG [pool-5-thread-4] common.HadoopCmdOutput:94 : Counters: 49 File System Counters FILE: Number of bytes read=20 FILE: Number of bytes written=963373 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=1902 HDFS: Number of bytes written=120 HDFS: Number of read operations=27 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 Job Counters Launched map tasks=6 Launched reduce tasks=1 Data-local map tasks=6 Total time spent by all maps in occupied slots (ms)=96679 Total time spent by all reduces in occupied slots (ms)=6519 Total time spent by all map tasks (ms)=96679 Total time spent by all reduce tasks (ms)=6519 Total vcore-seconds taken by all map tasks=96679 Total vcore-seconds taken by all reduce tasks=6519 Total megabyte-seconds taken by all map tasks=24169750 Total megabyte-seconds taken by all reduce tasks=1629750 Map-Reduce Framework Map input records=0 Map output records=0 Map output bytes=0 Map output materialized bytes=96 Input split bytes=1176 Combine input records=0 Combine output records=0 Reduce input groups=0 Reduce shuffle bytes=96 Reduce input records=0 Reduce output records=0 Spilled Records=0 Shuffled Maps =6 Failed Shuffles=0 Merged Map outputs=6 GC time elapsed (ms)=1426 CPU time spent (ms)=12240 Physical memory (bytes) snapshot=1456173056 Virtual memory (bytes) snapshot=5894418432 Total committed heap usage (bytes)=929038336 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=726 File Output Format Counters Bytes Written=120 2016-08-15 09:45:21,146 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254319539, to newTs: 1471254321141, operation result: true 2016-08-15 09:45:21,153 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254321141, to newTs: 1471254321149, operation result: true 2016-08-15 09:45:21,161 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from oldTs: 1471254321149, to newTs: 1471254321157, operation result: true 2016-08-15 09:45:21,161 INFO [pool-5-thread-4] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-03 from RUNNING to SUCCEED 2016-08-15 09:45:21,180 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254274760, to newTs: 1471254321176, operation result: true 2016-08-15 09:45:21,208 DEBUG [pool-5-thread-4] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254321176, to newTs: 1471254321202, operation result: true 2016-08-15 09:45:21,208 INFO [pool-5-thread-4] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:45:21,359 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:45:21,370 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:45:21,370 INFO [pool-5-thread-5] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:45:21,381 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:45:21,388 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254321202, to newTs: 1471254321380, operation result: true 2016-08-15 09:45:21,388 INFO [pool-5-thread-5] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:45:21,404 INFO [pool-5-thread-5] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Convert Cuboid Data to HFile <<<<<<<<<<<<< 2016-08-15 09:45:21,426 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254210965, to newTs: 1471254321413, operation result: true 2016-08-15 09:45:21,426 INFO [pool-5-thread-5] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from READY to RUNNING 2016-08-15 09:45:21,572 INFO [pool-5-thread-5] execution.AbstractExecutable:113 : parameters of the MapReduceExecutable: 2016-08-15 09:45:21,572 INFO [pool-5-thread-5] execution.AbstractExecutable:114 : -conf /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml -cubename Streaming_Cube -partitions hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/rowkey_stats/part-r-00000_hfile -input /kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/cuboid/* -output hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/hfile -htablename KYLIN_6I0AODXTI4 -jobname Kylin_HFile_Generator_Streaming_Cube_Step 2016-08-15 09:45:21,683 INFO [pool-5-thread-5] common.AbstractHadoopJob:161 : append job jar: /root/apache-kylin-1.5.2.1/bin/../lib/kylin-job-1.5.2.1.jar 2016-08-15 09:45:21,684 INFO [pool-5-thread-5] common.AbstractHadoopJob:168 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-08-15 09:45:21,684 INFO [pool-5-thread-5] common.AbstractHadoopJob:185 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-08-15 09:45:21,685 INFO [pool-5-thread-5] common.AbstractHadoopJob:197 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:45:21,716 INFO [pool-5-thread-5] common.AbstractHadoopJob:199 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:45:21,717 INFO [pool-5-thread-5] common.AbstractHadoopJob:336 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:45:21,734 DEBUG [pool-5-thread-5] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/cuboid 2016-08-15 09:45:21,794 INFO [pool-5-thread-5] common.KylinConfig:118 : The URI /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta is recognized as LOCAL_FOLDER 2016-08-15 09:45:21,795 INFO [pool-5-thread-5] common.KylinConfigBase:110 : Kylin Config was updated with kylin.metadata.url : /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta 2016-08-15 09:45:21,796 INFO [pool-5-thread-5] persistence.ResourceStore:82 : Using metadata url /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta for resource store 2016-08-15 09:45:21,799 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /cube/Streaming_Cube.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,804 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /model_desc/Streaming_Model.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,809 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /cube_desc/Streaming_Cube.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,813 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /table/DEFAULT.STREAMING_SALES_TABLE.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,816 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,820 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,822 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,825 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,830 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,833 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,836 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,839 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,845 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,849 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,852 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,855 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,859 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,862 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,867 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,870 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,873 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,877 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,881 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,884 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,888 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,892 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,896 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,900 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,903 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,907 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,910 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,915 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,918 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,921 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,924 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,927 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,932 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,935 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,939 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,942 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,947 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,950 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,953 DEBUG [pool-5-thread-5] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta) 2016-08-15 09:45:21,954 INFO [pool-5-thread-5] common.AbstractHadoopJob:472 : HDFS meta dir is: file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta 2016-08-15 09:45:21,954 INFO [pool-5-thread-5] common.AbstractHadoopJob:350 : Job 'tmpfiles' updated -- file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta 2016-08-15 09:45:25,038 INFO [pool-5-thread-5] common.AbstractHadoopJob:479 : tempMetaFileString is : file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta7340766124233097389/meta 2016-08-15 09:45:25,040 INFO [pool-5-thread-5] execution.AbstractExecutable:221 : kylin.job.yarn.app.rest.check.status.url is not set, read from job configuration 2016-08-15 09:45:25,041 INFO [pool-5-thread-5] execution.AbstractExecutable:237 : yarn.resourcemanager.webapp.address:http://sandbox.hortonworks.com:8088 2016-08-15 09:45:25,059 WARN [pool-5-thread-5] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:45:25,060 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:209 : Job job_1471242907167_0042 get status check result. 2016-08-15 09:45:25,060 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0042 status : {"app":{"id":"application_1471242907167_0042","user":"root","name":"Kylin_HFile_Generator_Streaming_Cube_Step","queue":"default","state":"ACCEPTED","finalStatus":"UNDEFINED","progress":0.0,"trackingUI":"UNASSIGNED","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254324788,"finishedTime":0,"elapsedTime":268,"allocatedMB":0,"allocatedVCores":0,"runningContainers":0,"memorySeconds":0,"vcoreSeconds":0,"queueUsagePercentage":0.0,"clusterUsagePercentage":0.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":1,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:45:25,062 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0042:ACCEPTED-UNDEFINED 2016-08-15 09:45:25,073 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254321413, to newTs: 1471254325067, operation result: true 2016-08-15 09:45:28,100 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 45 others 2016-08-15 09:45:35,082 WARN [pool-5-thread-5] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:45:35,083 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:209 : Job job_1471242907167_0042 get status check result. 2016-08-15 09:45:35,083 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0042 status : {"app":{"id":"application_1471242907167_0042","user":"root","name":"Kylin_HFile_Generator_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":0.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0042/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254324788,"finishedTime":0,"elapsedTime":10291,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0042_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":250,"allocatedVCores":1,"runningContainers":1,"memorySeconds":2436,"vcoreSeconds":9,"queueUsagePercentage":11.111112,"clusterUsagePercentage":11.111112,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:45:35,084 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0042:RUNNING-UNDEFINED 2016-08-15 09:45:35,096 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254325067, to newTs: 1471254335089, operation result: true 2016-08-15 09:45:35,114 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254335089, to newTs: 1471254335099, operation result: true 2016-08-15 09:45:45,126 WARN [pool-5-thread-5] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:45:45,127 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:209 : Job job_1471242907167_0042 get status check result. 2016-08-15 09:45:45,127 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0042 status : {"app":{"id":"application_1471242907167_0042","user":"root","name":"Kylin_HFile_Generator_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":50.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0042/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254324788,"finishedTime":0,"elapsedTime":20331,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0042_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":500,"allocatedVCores":2,"runningContainers":2,"memorySeconds":7133,"vcoreSeconds":27,"queueUsagePercentage":22.222223,"clusterUsagePercentage":22.222223,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:45:45,128 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0042:RUNNING-UNDEFINED 2016-08-15 09:45:45,142 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254335099, to newTs: 1471254345134, operation result: true 2016-08-15 09:45:55,159 WARN [pool-5-thread-5] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:45:55,160 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:209 : Job job_1471242907167_0042 get status check result. 2016-08-15 09:45:55,160 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0042 status : {"app":{"id":"application_1471242907167_0042","user":"root","name":"Kylin_HFile_Generator_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":50.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0042/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254324788,"finishedTime":0,"elapsedTime":30364,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0042_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":750,"allocatedVCores":3,"runningContainers":3,"memorySeconds":14208,"vcoreSeconds":54,"queueUsagePercentage":33.333336,"clusterUsagePercentage":33.333336,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:45:55,161 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0042:RUNNING-UNDEFINED 2016-08-15 09:45:55,174 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254345134, to newTs: 1471254355167, operation result: true 2016-08-15 09:46:05,180 WARN [pool-5-thread-5] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:46:05,180 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:209 : Job job_1471242907167_0042 get status check result. 2016-08-15 09:46:05,181 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0042 status : {"app":{"id":"application_1471242907167_0042","user":"root","name":"Kylin_HFile_Generator_Streaming_Cube_Step","queue":"default","state":"FINISHED","finalStatus":"SUCCEEDED","progress":100.0,"trackingUI":"History","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0042/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254324788,"finishedTime":1471254355493,"elapsedTime":30705,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0042_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":-1,"allocatedVCores":-1,"runningContainers":-1,"memorySeconds":16229,"vcoreSeconds":62,"queueUsagePercentage":0.0,"clusterUsagePercentage":0.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"logAggregationStatus":"SUCCEEDED"}} 2016-08-15 09:46:05,181 DEBUG [pool-5-thread-5] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0042:FINISHED-SUCCEEDED 2016-08-15 09:46:05,189 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254355167, to newTs: 1471254365184, operation result: true 2016-08-15 09:46:05,351 DEBUG [pool-5-thread-5] common.HadoopCmdOutput:94 : Counters: 49 File System Counters FILE: Number of bytes read=40 FILE: Number of bytes written=429955 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=495 HDFS: Number of bytes written=0 HDFS: Number of read operations=8 HDFS: Number of large read operations=0 HDFS: Number of write operations=0 Job Counters Launched map tasks=1 Launched reduce tasks=2 Data-local map tasks=1 Total time spent by all maps in occupied slots (ms)=6981 Total time spent by all reduces in occupied slots (ms)=14292 Total time spent by all map tasks (ms)=6981 Total time spent by all reduce tasks (ms)=14292 Total vcore-seconds taken by all map tasks=6981 Total vcore-seconds taken by all reduce tasks=14292 Total megabyte-seconds taken by all map tasks=1745250 Total megabyte-seconds taken by all reduce tasks=3573000 Map-Reduce Framework Map input records=0 Map output records=0 Map output bytes=0 Map output materialized bytes=32 Input split bytes=200 Combine input records=0 Combine output records=0 Reduce input groups=0 Reduce shuffle bytes=32 Reduce input records=0 Reduce output records=0 Spilled Records=0 Shuffled Maps =2 Failed Shuffles=0 Merged Map outputs=2 GC time elapsed (ms)=560 CPU time spent (ms)=4650 Physical memory (bytes) snapshot=516251648 Virtual memory (bytes) snapshot=2588344320 Total committed heap usage (bytes)=396886016 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 File Input Format Counters Bytes Read=120 File Output Format Counters Bytes Written=0 2016-08-15 09:46:05,371 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254365184, to newTs: 1471254365364, operation result: true 2016-08-15 09:46:05,386 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254365364, to newTs: 1471254365373, operation result: true 2016-08-15 09:46:05,398 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from oldTs: 1471254365373, to newTs: 1471254365391, operation result: true 2016-08-15 09:46:05,398 INFO [pool-5-thread-5] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-04 from RUNNING to SUCCEED 2016-08-15 09:46:05,428 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254321380, to newTs: 1471254365424, operation result: true 2016-08-15 09:46:05,453 DEBUG [pool-5-thread-5] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254365424, to newTs: 1471254365449, operation result: true 2016-08-15 09:46:05,453 INFO [pool-5-thread-5] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:46:05,616 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:46:05,617 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:46:05,618 INFO [pool-5-thread-6] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:46:05,626 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:46:05,631 DEBUG [pool-5-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254365449, to newTs: 1471254365626, operation result: true 2016-08-15 09:46:05,631 INFO [pool-5-thread-6] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:46:05,645 INFO [pool-5-thread-6] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Load HFile to HBase Table <<<<<<<<<<<<< 2016-08-15 09:46:05,651 DEBUG [pool-5-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-05 from oldTs: 1471254210970, to newTs: 1471254365647, operation result: true 2016-08-15 09:46:05,651 INFO [pool-5-thread-6] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-05 from READY to RUNNING 2016-08-15 09:46:05,690 INFO [pool-5-thread-6] execution.AbstractExecutable:55 : parameters of the HadoopShellExecutable: 2016-08-15 09:46:05,690 INFO [pool-5-thread-6] execution.AbstractExecutable:56 : -input hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/hfile -htablename KYLIN_6I0AODXTI4 -cubename Streaming_Cube 2016-08-15 09:46:05,870 DEBUG [pool-5-thread-6] steps.BulkLoadJob:71 : Start to run LoadIncrementalHFiles 2016-08-15 09:46:06,058 DEBUG [pool-5-thread-6] steps.BulkLoadJob:73 : End to run LoadIncrementalHFiles 2016-08-15 09:46:06,065 DEBUG [pool-5-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-05 from oldTs: 1471254365647, to newTs: 1471254366060, operation result: true 2016-08-15 09:46:06,075 DEBUG [pool-5-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-05 from oldTs: 1471254366060, to newTs: 1471254366070, operation result: true 2016-08-15 09:46:06,076 INFO [pool-5-thread-6] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-05 from RUNNING to SUCCEED 2016-08-15 09:46:06,126 DEBUG [pool-5-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254365626, to newTs: 1471254366120, operation result: true 2016-08-15 09:46:06,210 DEBUG [pool-5-thread-6] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254366120, to newTs: 1471254366204, operation result: true 2016-08-15 09:46:06,210 INFO [pool-5-thread-6] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:46:06,456 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:46:06,457 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:46:06,457 INFO [pool-5-thread-7] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:46:06,463 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:46:06,466 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254366204, to newTs: 1471254366462, operation result: true 2016-08-15 09:46:06,466 INFO [pool-5-thread-7] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:46:06,489 INFO [pool-5-thread-7] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Update Cube Info <<<<<<<<<<<<< 2016-08-15 09:46:06,496 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-06 from oldTs: 1471254210974, to newTs: 1471254366492, operation result: true 2016-08-15 09:46:06,497 INFO [pool-5-thread-7] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-06 from READY to RUNNING 2016-08-15 09:46:06,515 INFO [pool-5-thread-7] cube.CubeManager:715 : Promoting cube CUBE[name=Streaming_Cube], new segments [Streaming_Cube[20160815070500_20160815073500]], to remove segments [Streaming_Cube[20160815070500_20160815071000], Streaming_Cube[20160815071000_20160815071500], Streaming_Cube[20160815071500_20160815072000], Streaming_Cube[20160815072000_20160815072500], Streaming_Cube[20160815072500_20160815073000], Streaming_Cube[20160815073000_20160815073500]] 2016-08-15 09:46:06,516 INFO [pool-5-thread-7] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:46:06,526 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254270929, to newTs: 1471254366516, operation result: true 2016-08-15 09:46:06,526 DEBUG [pool-5-thread-7] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/6bdc957a-0946-4e99-91af-73fe2d12d115.seq (Store kylin_metadata@hbase) 2016-08-15 09:46:06,539 DEBUG [pool-5-thread-7] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/f6b0b56b-6d9a-40c0-8ccf-35e0a8bc654d.seq (Store kylin_metadata@hbase) 2016-08-15 09:46:06,542 DEBUG [pool-5-thread-7] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/49bb7b3a-6fa0-4209-9474-e327d2f6ff32.seq (Store kylin_metadata@hbase) 2016-08-15 09:46:06,544 DEBUG [pool-5-thread-7] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/788ddf0e-ee45-4c1c-8398-4cde29fc9311.seq (Store kylin_metadata@hbase) 2016-08-15 09:46:06,547 DEBUG [pool-5-thread-7] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/1c1b5793-953a-4b0f-9721-1fcca1b95d2f.seq (Store kylin_metadata@hbase) 2016-08-15 09:46:06,550 DEBUG [pool-5-thread-7] persistence.ResourceStore:260 : Deleting resource /cube_statistics/Streaming_Cube/43cbe4e3-d756-406e-90d7-b0d343270339.seq (Store kylin_metadata@hbase) 2016-08-15 09:46:06,554 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:46:06,562 INFO [http-bio-7070-exec-2] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:46:06,563 INFO [http-bio-7070-exec-2] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:46:06,563 DEBUG [pool-5-thread-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 11 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:46:06,567 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 11 segments:KYLIN_O71JLBZAOY,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:46:06,570 INFO [pool-5-thread-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:46:06,570 INFO [pool-5-thread-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:46:06,570 DEBUG [pool-5-thread-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:46:06,570 DEBUG [pool-5-thread-7] service.CubeService:591 : server mode: all 2016-08-15 09:46:06,570 INFO [pool-5-thread-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:46:06,571 DEBUG [pool-5-thread-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:46:06,571 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:46:06,572 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:46:06,572 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:46:06,572 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 09:46:06,572 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:46:06,572 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:46:06,582 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-06 from oldTs: 1471254366492, to newTs: 1471254366575, operation result: true 2016-08-15 09:46:06,595 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-06 from oldTs: 1471254366575, to newTs: 1471254366590, operation result: true 2016-08-15 09:46:06,595 INFO [pool-5-thread-7] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-06 from RUNNING to SUCCEED 2016-08-15 09:46:06,648 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254366462, to newTs: 1471254366639, operation result: true 2016-08-15 09:46:06,680 DEBUG [pool-5-thread-7] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254366639, to newTs: 1471254366676, operation result: true 2016-08-15 09:46:06,681 INFO [pool-5-thread-7] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:46:06,784 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:46:06,785 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:46:06,785 INFO [pool-5-thread-8] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:46:06,792 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:46:06,795 DEBUG [pool-5-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254366676, to newTs: 1471254366790, operation result: true 2016-08-15 09:46:06,795 INFO [pool-5-thread-8] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:46:06,812 INFO [pool-5-thread-8] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Garbage Collection <<<<<<<<<<<<< 2016-08-15 09:46:06,819 DEBUG [pool-5-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-07 from oldTs: 1471254210982, to newTs: 1471254366814, operation result: true 2016-08-15 09:46:06,820 INFO [pool-5-thread-8] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-07 from READY to RUNNING 2016-08-15 09:46:06,820 INFO [pool-5-thread-8] steps.MergeGCStep:60 : Sleep one minute before deleting the Htables 2016-08-15 09:46:28,086 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 45 others 2016-08-15 09:47:06,820 INFO [pool-5-thread-8] steps.MergeGCStep:66 : Start doing merge gc work 2016-08-15 09:47:13,146 DEBUG [pool-5-thread-8] steps.MergeGCStep:86 : Dropped htable: KYLIN_LCYIKZ5ADM 2016-08-15 09:47:19,437 DEBUG [pool-5-thread-8] steps.MergeGCStep:86 : Dropped htable: KYLIN_462LVA085U 2016-08-15 09:47:25,683 DEBUG [pool-5-thread-8] steps.MergeGCStep:86 : Dropped htable: KYLIN_LOOYD7D3MW 2016-08-15 09:47:27,995 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 45 others 2016-08-15 09:47:31,926 DEBUG [pool-5-thread-8] steps.MergeGCStep:86 : Dropped htable: KYLIN_AV1FSW1TI1 2016-08-15 09:47:37,018 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 09:47:37,063 DEBUG [http-bio-7070-exec-9] service.AdminService:90 : Get Kylin Runtime Config 2016-08-15 09:47:37,282 DEBUG [http-bio-7070-exec-9] controller.ProjectController:97 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 09:47:37,530 INFO [http-bio-7070-exec-1] project.ProjectL2Cache:173 : Loading L2 project cache for KAFKA_STREAMING 2016-08-15 09:47:37,530 INFO [http-bio-7070-exec-1] controller.TableController:95 : Return all table metadata in 0 seconds 2016-08-15 09:47:38,180 DEBUG [pool-5-thread-8] steps.MergeGCStep:86 : Dropped htable: KYLIN_N3F0URAEYE 2016-08-15 09:47:41,190 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_J5P5V4L48C". 2016-08-15 09:47:41,216 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_TXZXP1VV8E". 2016-08-15 09:47:41,234 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_V6253723CB". 2016-08-15 09:47:41,248 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_SS098AG7K8". 2016-08-15 09:47:41,263 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_KZIS9HDWC6". 2016-08-15 09:47:41,291 INFO [http-bio-7070-exec-9] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_6I0AODXTI4". 2016-08-15 09:47:44,511 DEBUG [pool-5-thread-8] steps.MergeGCStep:86 : Dropped htable: KYLIN_F3G3LU57KA 2016-08-15 09:47:44,517 DEBUG [pool-5-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-07 from oldTs: 1471254366814, to newTs: 1471254464514, operation result: true 2016-08-15 09:47:44,526 DEBUG [pool-5-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-07 from oldTs: 1471254464514, to newTs: 1471254464522, operation result: true 2016-08-15 09:47:44,526 INFO [pool-5-thread-8] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-07 from RUNNING to SUCCEED 2016-08-15 09:47:44,551 DEBUG [pool-5-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254366790, to newTs: 1471254464547, operation result: true 2016-08-15 09:47:44,577 DEBUG [pool-5-thread-8] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254464547, to newTs: 1471254464573, operation result: true 2016-08-15 09:47:44,577 INFO [pool-5-thread-8] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to READY 2016-08-15 09:47:44,681 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} prepare to schedule 2016-08-15 09:47:44,682 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=f0bdc76b-93d1-47bf-81e1-2dfdb000eb84, name=Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30, state=READY} scheduled 2016-08-15 09:47:44,682 INFO [pool-5-thread-9] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815070500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:43:30 <<<<<<<<<<<<< 2016-08-15 09:47:44,687 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 45 others 2016-08-15 09:47:44,690 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254464573, to newTs: 1471254464686, operation result: true 2016-08-15 09:47:44,690 INFO [pool-5-thread-9] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from READY to RUNNING 2016-08-15 09:47:44,707 INFO [pool-5-thread-9] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Garbage Collection on HDFS <<<<<<<<<<<<< 2016-08-15 09:47:44,713 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-08 from oldTs: 1471254210987, to newTs: 1471254464709, operation result: true 2016-08-15 09:47:44,713 INFO [pool-5-thread-9] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-08 from READY to RUNNING 2016-08-15 09:47:44,741 DEBUG [pool-5-thread-9] execution.AbstractExecutable:74 : Drop HDFS path on FileSystem: hdfs://sandbox.hortonworks.com:8020 2016-08-15 09:47:44,759 DEBUG [pool-5-thread-9] execution.AbstractExecutable:83 : HDFS path /kylin/kylin_metadata/kylin-6bdc957a-0946-4e99-91af-73fe2d12d115 is dropped. 2016-08-15 09:47:44,766 DEBUG [pool-5-thread-9] execution.AbstractExecutable:83 : HDFS path /kylin/kylin_metadata/kylin-f6b0b56b-6d9a-40c0-8ccf-35e0a8bc654d is dropped. 2016-08-15 09:47:44,774 DEBUG [pool-5-thread-9] execution.AbstractExecutable:83 : HDFS path /kylin/kylin_metadata/kylin-49bb7b3a-6fa0-4209-9474-e327d2f6ff32 is dropped. 2016-08-15 09:47:44,787 DEBUG [pool-5-thread-9] execution.AbstractExecutable:83 : HDFS path /kylin/kylin_metadata/kylin-788ddf0e-ee45-4c1c-8398-4cde29fc9311 is dropped. 2016-08-15 09:47:44,795 DEBUG [pool-5-thread-9] execution.AbstractExecutable:83 : HDFS path /kylin/kylin_metadata/kylin-1c1b5793-953a-4b0f-9721-1fcca1b95d2f is dropped. 2016-08-15 09:47:44,803 DEBUG [pool-5-thread-9] execution.AbstractExecutable:83 : HDFS path /kylin/kylin_metadata/kylin-43cbe4e3-d756-406e-90d7-b0d343270339 is dropped. 2016-08-15 09:47:44,813 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-08 from oldTs: 1471254464709, to newTs: 1471254464809, operation result: true 2016-08-15 09:47:44,821 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-08 from oldTs: 1471254464809, to newTs: 1471254464816, operation result: true 2016-08-15 09:47:44,822 INFO [pool-5-thread-9] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84-08 from RUNNING to SUCCEED 2016-08-15 09:47:44,857 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254464686, to newTs: 1471254464854, operation result: true 2016-08-15 09:47:44,881 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254464854, to newTs: 1471254464877, operation result: true 2016-08-15 09:47:44,886 DEBUG [pool-5-thread-9] hbase.HBaseResourceStore:262 : Update row /execute_output/f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from oldTs: 1471254464877, to newTs: 1471254464883, operation result: true 2016-08-15 09:47:44,886 INFO [pool-5-thread-9] manager.ExecutableManager:274 : job id:f0bdc76b-93d1-47bf-81e1-2dfdb000eb84 from RUNNING to SUCCEED 2016-08-15 09:47:44,887 WARN [pool-5-thread-9] execution.AbstractExecutable:224 : no need to send email, user list is empty 2016-08-15 09:47:44,978 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 46 others 2016-08-15 09:48:01,484 ERROR [http-bio-7070-exec-3] controller.BasicController:44 : java.lang.IllegalArgumentException: Empty cube segment found, couldn't merge unless 'forceMergeEmptySegment' set to true: [20160815045500_20160815050000, 20160815050000_20160815050500, 20160815050500_20160815051000, 20160815051000_20160815051500, 20160815051500_20160815052000, 20160815064000_20160815064500, 20160815064500_20160815065000, 20160815065000_20160815065500, 20160815065500_20160815070000, 20160815070000_20160815070500, 20160815070500_20160815073500] at org.apache.kylin.cube.CubeManager.mergeSegments(CubeManager.java:487) at org.apache.kylin.rest.service.JobService.submitJob(JobService.java:211) at org.apache.kylin.rest.service.JobService$$FastClassByCGLIB$$83a44b2a.invoke() at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) at org.apache.kylin.rest.service.JobService$$EnhancerByCGLIB$$6cea0dd3.submitJob() at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:251) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:800) at javax.servlet.http.HttpServlet.service(HttpServlet.java:649) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:205) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) 2016-08-15 09:48:05,090 INFO [http-bio-7070-exec-10] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:48:05,109 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254366516, to newTs: 1471254485092, operation result: true 2016-08-15 09:48:05,109 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:48:05,116 INFO [http-bio-7070-exec-7] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:48:05,116 INFO [http-bio-7070-exec-7] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:48:05,118 DEBUG [http-bio-7070-exec-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_EL7ZJ9A868,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:48:05,124 DEBUG [http-bio-7070-exec-7] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_EL7ZJ9A868,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:48:05,127 INFO [http-bio-7070-exec-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:48:05,127 INFO [http-bio-7070-exec-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:48:05,127 INFO [http-bio-7070-exec-7] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:48:05,128 INFO [http-bio-7070-exec-7] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:48:05,127 DEBUG [http-bio-7070-exec-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:48:05,128 DEBUG [http-bio-7070-exec-7] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:48:05,128 DEBUG [http-bio-7070-exec-10] service.CubeService:591 : server mode: all 2016-08-15 09:48:05,129 DEBUG [http-bio-7070-exec-7] service.CubeService:591 : server mode: all 2016-08-15 09:48:05,129 INFO [http-bio-7070-exec-7] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:48:05,129 INFO [http-bio-7070-exec-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:48:05,129 DEBUG [http-bio-7070-exec-7] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:48:05,130 DEBUG [http-bio-7070-exec-7] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:48:05,130 DEBUG [http-bio-7070-exec-10] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:48:05,130 DEBUG [http-bio-7070-exec-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:48:05,130 INFO [http-bio-7070-exec-10] mr.BatchMergeJobBuilder2:48 : MR_V2 new job to MERGE segment Streaming_Cube[20160815045500_20160815073500] 2016-08-15 09:48:05,132 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:96 : Chosen job conf is : /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml 2016-08-15 09:48:05,132 INFO [http-bio-7070-exec-10] engine.JobEngineConfig:96 : Chosen job conf is : /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml 2016-08-15 09:48:05,141 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 0, to newTs: 1471254485135, operation result: true 2016-08-15 09:48:05,145 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 0, to newTs: 1471254485141, operation result: true 2016-08-15 09:48:05,149 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-00 from oldTs: 0, to newTs: 1471254485145, operation result: true 2016-08-15 09:48:05,154 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-01 from oldTs: 0, to newTs: 1471254485149, operation result: true 2016-08-15 09:48:05,159 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-02 from oldTs: 0, to newTs: 1471254485155, operation result: true 2016-08-15 09:48:05,163 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 0, to newTs: 1471254485159, operation result: true 2016-08-15 09:48:05,167 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-04 from oldTs: 0, to newTs: 1471254485163, operation result: true 2016-08-15 09:48:05,171 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-05 from oldTs: 0, to newTs: 1471254485167, operation result: true 2016-08-15 09:48:05,176 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-06 from oldTs: 0, to newTs: 1471254485172, operation result: true 2016-08-15 09:48:05,181 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-07 from oldTs: 0, to newTs: 1471254485177, operation result: true 2016-08-15 09:48:05,187 DEBUG [http-bio-7070-exec-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-08 from oldTs: 0, to newTs: 1471254485181, operation result: true 2016-08-15 09:48:05,219 DEBUG [http-bio-7070-exec-10] service.AclService:239 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.job.JobInstance; Identifier: 8f86f44c-ccbd-4368-a2fe-6976e4a10282] created successfully. 2016-08-15 09:48:05,223 DEBUG [http-bio-7070-exec-10] service.AclService:239 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.cube.CubeInstance; Identifier: bc694137-2f18-4381-a855-d26ccc742a36] created successfully. 2016-08-15 09:48:05,224 DEBUG [http-bio-7070-exec-10] service.AclService:306 : ACL of org.springframework.security.acls.domain.ObjectIdentityImpl[Type: org.apache.kylin.job.JobInstance; Identifier: 8f86f44c-ccbd-4368-a2fe-6976e4a10282] updated successfully. 2016-08-15 09:48:07,910 INFO [http-bio-7070-exec-4] util.HBaseRegionSizeCalculator:62 : Calculating region sizes for table "KYLIN_EL7ZJ9A868". 2016-08-15 09:48:18,108 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 09:48:18,168 DEBUG [http-bio-7070-exec-4] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-08-15 09:48:27,974 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} prepare to schedule 2016-08-15 09:48:27,974 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} scheduled 2016-08-15 09:48:27,975 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05 <<<<<<<<<<<<< 2016-08-15 09:48:27,986 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254485141, to newTs: 1471254507982, operation result: true 2016-08-15 09:48:27,987 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from READY to RUNNING 2016-08-15 09:48:27,990 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Merge Cuboid Dictionary <<<<<<<<<<<<< 2016-08-15 09:48:28,002 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-00 from oldTs: 1471254485145, to newTs: 1471254507995, operation result: true 2016-08-15 09:48:28,004 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-00 from READY to RUNNING 2016-08-15 09:48:28,005 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.MINUTE_START 2016-08-15 09:48:28,005 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,005 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,005 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,005 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,006 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,007 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,007 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.DAY_START 2016-08-15 09:48:28,007 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,007 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,007 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,007 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.COUNTRY 2016-08-15 09:48:28,008 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,009 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,009 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,009 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,009 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,009 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,009 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.ORDER_TIME 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,010 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,011 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,011 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,011 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,011 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,013 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,013 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,013 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,014 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,014 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,014 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,014 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.HOUR_START 2016-08-15 09:48:28,014 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,014 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,015 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,015 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,015 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,015 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,015 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,015 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,018 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,018 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,018 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.DEVICE 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,019 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.CURRENCY 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,020 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,021 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,022 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,022 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,022 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 46 others 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:118 : Merging fact table dictionary on : DEFAULT.STREAMING_SALES_TABLE.CATEGORY 2016-08-15 09:48:28,023 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815045500_20160815050000] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050000_20160815050500] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815050500_20160815051000] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051000_20160815051500] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815051500_20160815052000] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064000_20160815064500] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815064500_20160815065000] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065000_20160815065500] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815065500_20160815070000] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070000_20160815070500] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] execution.AbstractExecutable:121 : Including fact table dictionary of segment : Streaming_Cube[20160815070500_20160815073500] 2016-08-15 09:48:28,024 INFO [pool-5-thread-10] dict.DictionaryManager:255 : Use one of the merging dictionaries directly 2016-08-15 09:48:28,025 INFO [pool-5-thread-10] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:48:28,031 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254485092, to newTs: 1471254508025, operation result: true 2016-08-15 09:48:28,031 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:48:28,036 INFO [http-bio-7070-exec-8] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:48:28,036 INFO [http-bio-7070-exec-8] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:48:28,038 DEBUG [pool-5-thread-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_EL7ZJ9A868,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:48:28,042 INFO [pool-5-thread-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:48:28,043 INFO [pool-5-thread-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:48:28,043 DEBUG [pool-5-thread-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:48:28,043 DEBUG [pool-5-thread-10] service.CubeService:591 : server mode: all 2016-08-15 09:48:28,043 INFO [pool-5-thread-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:48:28,043 DEBUG [pool-5-thread-10] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:48:28,044 DEBUG [pool-5-thread-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:48:28,044 DEBUG [http-bio-7070-exec-8] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_EL7ZJ9A868,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:48:28,048 INFO [http-bio-7070-exec-8] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:48:28,049 INFO [http-bio-7070-exec-8] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:48:28,049 DEBUG [http-bio-7070-exec-8] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:48:28,050 DEBUG [http-bio-7070-exec-8] service.CubeService:591 : server mode: all 2016-08-15 09:48:28,050 INFO [http-bio-7070-exec-8] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:48:28,050 DEBUG [http-bio-7070-exec-8] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:48:28,051 DEBUG [http-bio-7070-exec-8] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:48:28,053 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-00 from oldTs: 1471254507995, to newTs: 1471254508048, operation result: true 2016-08-15 09:48:28,060 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-00 from oldTs: 1471254508048, to newTs: 1471254508056, operation result: true 2016-08-15 09:48:28,060 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-00 from RUNNING to SUCCEED 2016-08-15 09:48:28,072 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254507982, to newTs: 1471254508067, operation result: true 2016-08-15 09:48:28,098 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254508067, to newTs: 1471254508094, operation result: true 2016-08-15 09:48:28,098 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from RUNNING to READY 2016-08-15 09:48:28,165 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} prepare to schedule 2016-08-15 09:48:28,166 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} scheduled 2016-08-15 09:48:28,166 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05 <<<<<<<<<<<<< 2016-08-15 09:48:28,174 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254508094, to newTs: 1471254508170, operation result: true 2016-08-15 09:48:28,174 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from READY to RUNNING 2016-08-15 09:48:28,180 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Merge Cuboid Statistics <<<<<<<<<<<<< 2016-08-15 09:48:28,187 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-01 from oldTs: 1471254485149, to newTs: 1471254508182, operation result: true 2016-08-15 09:48:28,187 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-01 from READY to RUNNING 2016-08-15 09:48:28,202 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 46 others 2016-08-15 09:48:28,582 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /cube_statistics/Streaming_Cube/ac41a553-a279-43c4-9c46-cc4f875d6c3b.seq (Store kylin_metadata@hbase) 2016-08-15 09:48:28,605 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-01 from oldTs: 1471254508182, to newTs: 1471254508601, operation result: true 2016-08-15 09:48:28,612 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-01 from oldTs: 1471254508601, to newTs: 1471254508609, operation result: true 2016-08-15 09:48:28,612 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-01 from RUNNING to SUCCEED 2016-08-15 09:48:28,624 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254508170, to newTs: 1471254508620, operation result: true 2016-08-15 09:48:28,649 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254508620, to newTs: 1471254508645, operation result: true 2016-08-15 09:48:28,650 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from RUNNING to READY 2016-08-15 09:48:28,720 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} prepare to schedule 2016-08-15 09:48:28,720 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} scheduled 2016-08-15 09:48:28,720 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05 <<<<<<<<<<<<< 2016-08-15 09:48:28,729 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254508645, to newTs: 1471254508725, operation result: true 2016-08-15 09:48:28,729 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from READY to RUNNING 2016-08-15 09:48:28,738 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Create HTable <<<<<<<<<<<<< 2016-08-15 09:48:28,750 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-02 from oldTs: 1471254485155, to newTs: 1471254508742, operation result: true 2016-08-15 09:48:28,750 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-02 from READY to RUNNING 2016-08-15 09:48:28,764 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 46 others 2016-08-15 09:48:28,776 INFO [pool-5-thread-10] execution.AbstractExecutable:55 : parameters of the HadoopShellExecutable: 2016-08-15 09:48:28,776 INFO [pool-5-thread-10] execution.AbstractExecutable:56 : -cubename Streaming_Cube -segmentname 20160815045500_20160815073500 -partitions hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-8f86f44c-ccbd-4368-a2fe-6976e4a10282/Streaming_Cube/rowkey_stats/part-r-00000 -statisticsenabled true 2016-08-15 09:48:28,877 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,878 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 136 has 80 rows, each row size is 33 bytes. Total size is 6.29425048828125E-4M. 2016-08-15 09:48:28,878 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,878 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 4 has 4 rows, each row size is 31 bytes. Total size is 2.956390380859375E-5M. 2016-08-15 09:48:28,878 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 8 has 11 rows, each row size is 29 bytes. Total size is 7.605552673339844E-5M. 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 128 has 20 rows, each row size is 32 bytes. Total size is 1.52587890625E-4M. 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 12 has 32 rows, each row size is 32 bytes. Total size is 2.44140625E-4M. 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 152 has 392 rows, each row size is 34 bytes. Total size is 0.003177642822265625M. 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,879 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 16 has 9 rows, each row size is 29 bytes. Total size is 6.222724914550781E-5M. 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 20 has 4 rows, each row size is 32 bytes. Total size is 3.0517578125E-5M. 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 144 has 157 rows, each row size is 33 bytes. Total size is 0.0012352466583251953M. 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 24 has 40 rows, each row size is 30 bytes. Total size is 2.86102294921875E-4M. 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 28 has 32 rows, each row size is 33 bytes. Total size is 2.5177001953125E-4M. 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 32 has 6 rows, each row size is 29 bytes. Total size is 4.1484832763671875E-5M. 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,880 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 168 has 80 rows, each row size is 34 bytes. Total size is 6.4849853515625E-4M. 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 36 has 19 rows, each row size is 32 bytes. Total size is 1.4495849609375E-4M. 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 40 has 41 rows, each row size is 30 bytes. Total size is 2.932548522949219E-4M. 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 160 has 20 rows, each row size is 33 bytes. Total size is 1.5735626220703125E-4M. 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 44 has 96 rows, each row size is 33 bytes. Total size is 7.5531005859375E-4M. 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,881 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 184 has 393 rows, each row size is 35 bytes. Total size is 0.003279447555541992M. 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 48 has 13 rows, each row size is 30 bytes. Total size is 9.298324584960938E-5M. 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 52 has 20 rows, each row size is 33 bytes. Total size is 1.5735626220703125E-4M. 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 176 has 156 rows, each row size is 34 bytes. Total size is 0.0012645721435546875M. 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 56 has 69 rows, each row size is 31 bytes. Total size is 5.099773406982422E-4M. 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 60 has 96 rows, each row size is 34 bytes. Total size is 7.781982421875E-4M. 2016-08-15 09:48:28,882 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 68 has 20 rows, each row size is 32 bytes. Total size is 1.52587890625E-4M. 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 64 has 10 rows, each row size is 29 bytes. Total size is 6.914138793945312E-5M. 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 200 has 316 rows, each row size is 34 bytes. Total size is 0.0025615692138671875M. 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 76 has 93 rows, each row size is 33 bytes. Total size is 7.317066192626953E-4M. 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 72 has 59 rows, each row size is 30 bytes. Total size is 4.220008850097656E-4M. 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 192 has 100 rows, each row size is 33 bytes. Total size is 7.867813110351562E-4M. 2016-08-15 09:48:28,883 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 84 has 20 rows, each row size is 33 bytes. Total size is 1.5735626220703125E-4M. 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 216 has 549 rows, each row size is 35 bytes. Total size is 0.0045812129974365234M. 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 80 has 45 rows, each row size is 30 bytes. Total size is 3.218650817871094E-4M. 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 92 has 92 rows, each row size is 34 bytes. Total size is 7.457733154296875E-4M. 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 208 has 430 rows, each row size is 34 bytes. Total size is 0.0034856796264648438M. 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 88 has 197 rows, each row size is 31 bytes. Total size is 0.0014560222625732422M. 2016-08-15 09:48:28,884 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 100 has 77 rows, each row size is 33 bytes. Total size is 6.058216094970703E-4M. 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 96 has 30 rows, each row size is 30 bytes. Total size is 2.1457672119140625E-4M. 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 232 has 311 rows, each row size is 35 bytes. Total size is 0.002595186233520508M. 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 108 has 133 rows, each row size is 34 bytes. Total size is 0.0010781288146972656M. 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 104 has 122 rows, each row size is 31 bytes. Total size is 9.016990661621094E-4M. 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,885 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 224 has 100 rows, each row size is 34 bytes. Total size is 8.106231689453125E-4M. 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 255 has 600 rows, each row size is 47 bytes. Total size is 0.0067234039306640625M. 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 116 has 76 rows, each row size is 34 bytes. Total size is 6.160736083984375E-4M. 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 248 has 551 rows, each row size is 36 bytes. Total size is 0.004729270935058594M. 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 112 has 65 rows, each row size is 31 bytes. Total size is 4.8041343688964844E-4M. 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 127 has 132 rows, each row size is 43 bytes. Total size is 0.0013532638549804688M. 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,886 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 124 has 133 rows, each row size is 35 bytes. Total size is 0.0011098384857177734M. 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 240 has 424 rows, each row size is 35 bytes. Total size is 0.0035381317138671875M. 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] common.CubeStatsReader:210 : Cube is not memory hungry, storage size estimation multiply 0.25 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] common.CubeStatsReader:213 : Cuboid 120 has 257 rows, each row size is 32 bytes. Total size is 0.00196075439453125M. 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] steps.CreateHTableJob:166 : Cut for HBase region is 5.0GB 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] steps.CreateHTableJob:197 : Region count is adjusted from 1 to 2 to help random sharding 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] steps.CreateHTableJob:204 : Total size 0.0564875602722168M (estimated) 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] steps.CreateHTableJob:205 : Expecting 2 regions. 2016-08-15 09:48:28,887 INFO [pool-5-thread-10] steps.CreateHTableJob:206 : Expecting 1 MB per region. 2016-08-15 09:48:28,888 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 4 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,888 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 8 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,888 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 12 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,888 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 16 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,889 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 20 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,889 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 24 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,890 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 28 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,890 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 32 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,890 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 36 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,890 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 40 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,891 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 44 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,891 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 48 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,891 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 52 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,891 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 56 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,892 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 60 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,892 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 64 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,892 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 68 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,892 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 72 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,893 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 76 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,893 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 80 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,893 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 84 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,893 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 88 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,894 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 92 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,894 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 96 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,894 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 100 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,894 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 104 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,895 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 108 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,895 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 112 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,895 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 116 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,895 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 120 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,895 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 124 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,896 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 127 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,896 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 128 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,896 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 136 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,896 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 144 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,897 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 152 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,897 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 160 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,897 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 168 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,897 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 176 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,898 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 184 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,898 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 192 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,898 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 200 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,898 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 208 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,899 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 216 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,899 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 224 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,899 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 232 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,899 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 240 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,899 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 248 's estimated size 0.00 MB will generate 1 regions 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] steps.CreateHTableJob:230 : Cuboid 255 's estimated size 0.01 MB will generate 1 regions 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] steps.CreateHTableJob:243 : Region 0's estimated size is 0.03 MB, accounting for 54.45 percent 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] steps.CreateHTableJob:243 : Region 1's estimated size is 0.03 MB, accounting for 45.55 percent 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 68 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 136 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 4 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,900 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 64 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 200 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 8 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 76 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 128 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 12 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 72 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 192 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 152 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,901 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 16 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 84 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 216 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 20 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 80 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 144 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 24 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 92 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 208 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 28 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 88 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,902 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 100 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,904 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 32 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,904 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 168 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,904 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 36 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,904 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 96 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,905 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 232 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,905 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 108 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,905 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 40 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,905 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 160 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,905 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 104 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,905 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 44 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 224 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 255 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 184 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 116 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 48 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 248 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 112 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 52 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 127 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,906 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 176 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,907 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 124 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,907 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 56 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,907 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 240 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,916 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 120 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,917 INFO [pool-5-thread-10] common.CuboidShardUtil:42 : Cuboid 60 has 1 shards, skip saving it as an optimization 2016-08-15 09:48:28,917 INFO [pool-5-thread-10] cube.CubeManager:321 : Updating cube instance 'Streaming_Cube' 2016-08-15 09:48:28,933 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /cube/Streaming_Cube.json from oldTs: 1471254508025, to newTs: 1471254508917, operation result: true 2016-08-15 09:48:28,934 INFO [pool-7-thread-1] restclient.Broadcaster:101 : new broadcast event:BroadcastEvent{type=cube, name=Streaming_Cube, action=update} 2016-08-15 09:48:28,944 INFO [http-bio-7070-exec-2] controller.CacheController:64 : wipe cache type: CUBE event:UPDATE name:Streaming_Cube 2016-08-15 09:48:28,944 INFO [http-bio-7070-exec-2] service.CacheService:171 : rebuild cache type: CUBE name:Streaming_Cube 2016-08-15 09:48:28,947 DEBUG [pool-5-thread-10] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_EL7ZJ9A868,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:48:28,959 INFO [pool-5-thread-10] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:48:28,959 INFO [pool-5-thread-10] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:48:28,959 DEBUG [pool-5-thread-10] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:48:28,959 DEBUG [pool-5-thread-10] service.CubeService:591 : server mode: all 2016-08-15 09:48:28,960 INFO [pool-5-thread-10] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:48:28,960 DEBUG [pool-5-thread-10] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:48:28,960 DEBUG [pool-5-thread-10] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:48:28,967 INFO [pool-5-thread-10] steps.CreateHTableJob:303 : hbase.hstore.compactionThreshold is 3 2016-08-15 09:48:28,967 INFO [pool-5-thread-10] steps.CreateHTableJob:311 : hfileSizeMB:1.0 2016-08-15 09:48:28,968 DEBUG [http-bio-7070-exec-2] cube.CubeManager:852 : Reloaded new cube: Streaming_Cube with reference beingCUBE[name=Streaming_Cube] having 12 segments:KYLIN_O71JLBZAOY,KYLIN_EL7ZJ9A868,KYLIN_RYLCSKWFA6,KYLIN_QI5RHA2QG8,KYLIN_6KDY71AMVZ,KYLIN_RQBYOKVTHM,KYLIN_J5P5V4L48C,KYLIN_TXZXP1VV8E,KYLIN_V6253723CB,KYLIN_SS098AG7K8,KYLIN_KZIS9HDWC6,KYLIN_6I0AODXTI4 2016-08-15 09:48:29,035 INFO [http-bio-7070-exec-2] service.CacheService:124 : removeOLAPDataSource is called for project Kafka_Streaming 2016-08-15 09:48:29,036 INFO [http-bio-7070-exec-2] service.CacheService:106 : cleaning cache for bc694137-2f18-4381-a855-d26ccc742a36 (currently remove all entries) 2016-08-15 09:48:29,036 DEBUG [http-bio-7070-exec-2] service.CubeService:588 : on updateOnNewSegmentReady: Streaming_Cube 2016-08-15 09:48:29,037 DEBUG [http-bio-7070-exec-2] service.CubeService:591 : server mode: all 2016-08-15 09:48:29,037 INFO [http-bio-7070-exec-2] service.CubeService:600 : checking keepCubeRetention 2016-08-15 09:48:29,038 DEBUG [http-bio-7070-exec-2] cube.CubeManager:632 : Cube Streaming_Cube has bulding segment, will not trigger merge at this moment 2016-08-15 09:48:29,039 DEBUG [http-bio-7070-exec-2] service.CubeService:650 : Not ready for merge on cube Streaming_Cube 2016-08-15 09:48:29,070 INFO [pool-5-thread-10] steps.CubeHTableUtil:167 : hbase will use snappy to compress data 2016-08-15 09:48:29,082 INFO [pool-5-thread-10] util.DeployCoprocessorCLI:189 : Add coprocessor on KYLIN_EL7ZJ9A868 2016-08-15 09:48:29,083 INFO [pool-5-thread-10] util.DeployCoprocessorCLI:169 : hbase table KYLIN_EL7ZJ9A868 deployed with coprocessor. 2016-08-15 09:48:32,206 INFO [pool-5-thread-10] steps.CubeHTableUtil:107 : create hbase table KYLIN_EL7ZJ9A868 done. 2016-08-15 09:48:32,213 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-02 from oldTs: 1471254508742, to newTs: 1471254512209, operation result: true 2016-08-15 09:48:32,221 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-02 from oldTs: 1471254512209, to newTs: 1471254512217, operation result: true 2016-08-15 09:48:32,221 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-02 from RUNNING to SUCCEED 2016-08-15 09:48:32,234 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254508725, to newTs: 1471254512230, operation result: true 2016-08-15 09:48:32,260 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254512230, to newTs: 1471254512256, operation result: true 2016-08-15 09:48:32,261 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from RUNNING to READY 2016-08-15 09:48:32,330 INFO [pool-4-thread-1] threadpool.DefaultScheduler:96 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} prepare to schedule 2016-08-15 09:48:32,330 INFO [pool-4-thread-1] threadpool.DefaultScheduler:100 : CubingJob{id=8f86f44c-ccbd-4368-a2fe-6976e4a10282, name=Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05, state=READY} scheduled 2016-08-15 09:48:32,330 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Streaming_Cube - 20160815045500_20160815073500 - MERGE - GMT+07:00 2016-08-15 16:48:05 <<<<<<<<<<<<< 2016-08-15 09:48:32,339 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254512256, to newTs: 1471254512335, operation result: true 2016-08-15 09:48:32,339 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from READY to RUNNING 2016-08-15 09:48:32,355 INFO [pool-5-thread-10] execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>> Merge Cuboid Data <<<<<<<<<<<<< 2016-08-15 09:48:32,365 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254485159, to newTs: 1471254512360, operation result: true 2016-08-15 09:48:32,365 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from READY to RUNNING 2016-08-15 09:48:32,378 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running, 1 ready, 46 others 2016-08-15 09:48:32,415 INFO [pool-5-thread-10] execution.AbstractExecutable:113 : parameters of the MapReduceExecutable: 2016-08-15 09:48:32,416 INFO [pool-5-thread-10] execution.AbstractExecutable:114 : -conf /root/apache-kylin-1.5.2.1/bin/../conf/kylin_job_conf.xml -cubename Streaming_Cube -segmentname 20160815045500_20160815073500 -input /kylin/kylin_metadata/kylin-995dc7a2-30b8-401f-ab72-a23fb43ed668/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-e7276b09-2f70-4cab-bf58-c619793919ee/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-a3c469b5-5c97-41ea-8ac8-317d1d4f7660/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-507ed5ec-8261-412b-9dc8-4c553ac5e300/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-24a778e4-c169-4d2f-847d-5322830c8b8e/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-70dfc307-a092-4eae-ac1c-d4fdaafbfb4a/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-a731291c-ed92-47e6-82f3-9669e0a583a9/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-5f3603eb-a545-4651-843a-cacd3945d464/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-78a8c843-2d2f-4355-8384-45417f4ceacf/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-fb778e8d-57cd-4c37-815b-515f4e5ac08e/Streaming_Cube/cuboid/*,/kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/cuboid/* -output /kylin/kylin_metadata/kylin-8f86f44c-ccbd-4368-a2fe-6976e4a10282/Streaming_Cube/cuboid/ -jobname Kylin_Merge_Cuboid_Streaming_Cube_Step 2016-08-15 09:48:32,439 INFO [pool-5-thread-10] steps.CuboidJob:56 : Starting: Kylin_Merge_Cuboid_Streaming_Cube_Step 2016-08-15 09:48:32,440 INFO [pool-5-thread-10] common.AbstractHadoopJob:161 : append job jar: /root/apache-kylin-1.5.2.1/bin/../lib/kylin-job-1.5.2.1.jar 2016-08-15 09:48:32,440 INFO [pool-5-thread-10] common.AbstractHadoopJob:168 : append kylin.hbase.dependency: /usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar to mapreduce.application.classpath 2016-08-15 09:48:32,440 INFO [pool-5-thread-10] common.AbstractHadoopJob:185 : Hadoop job classpath is: $PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.4.0.0-169/hadoop/lib/hadoop-lzo-0.6.0.2.4.0.0-169.jar:/etc/hadoop/conf/secure,/usr/hdp/2.4.0.0-169/hbase/lib/hbase-common.jar 2016-08-15 09:48:32,440 INFO [pool-5-thread-10] common.AbstractHadoopJob:197 : Hive Dependencies Before Filtered: /usr/hdp/current/hive-client/conf,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svn-commons-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/stax-api-1.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jcommander-1.32.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/derby-10.10.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-start-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/mail-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/opencsv-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-ant-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-pool-1.5.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpclient-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/super-csv-2.2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/stringtemplate-3.2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore.jar,/usr/hdp/2.4.0.0-169/hive/lib/parquet-hadoop-bundle-1.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-core-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compress-1.4.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-runtime-3.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ivy-2.4.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/jline-2.12.jar,/usr/hdp/2.4.0.0-169/hive/lib/activation-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-codec-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-launcher-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-fate-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/libfb303-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-accumulo-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/avro-1.7.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/eigenbase-properties-1.1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jetty-all-server-7.6.0.v20120127.jar,/usr/hdp/2.4.0.0-169/hive/lib/janino-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/httpmime-4.2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2-M1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger_solrj-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-commons-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-cli.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-core-3.2.10.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-beeline.jar,/usr/hdp/2.4.0.0-169/hive/lib/plexus-utils-1.5.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-httpclient-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/bonecp-0.8.0.RELEASE.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/antlr-2.7.7.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-hive-plugin-shim-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ojdbc6.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-api-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/apache-log4j-extras-1.2.17.jar,/usr/hdp/2.4.0.0-169/hive/lib/json-20090211.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi.jar,/usr/hdp/2.4.0.0-169/hive/lib/htrace-core-3.1.0-incubating.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-logging-1.1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-cli-1.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims.jar,/usr/hdp/2.4.0.0-169/hive/lib/maven-scm-provider-svnexe-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/httpcore-4.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/snappy-java-1.0.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-contrib.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-collections-3.2.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-serde-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-scheduler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/mysql-connector-java.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/2.4.0.0-169/hive/lib/libthrift-0.9.2.jar,/usr/hdp/2.4.0.0-169/hive/lib/zookeeper-3.4.6.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hwi-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-dbcp-1.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/oro-2.0.8.jar,/usr/hdp/2.4.0.0-169/hive/lib/protobuf-java-2.5.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/groovy-all-2.1.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.23-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-compiler-2.7.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/velocity-1.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-0.20S-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-math-2.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-framework-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/log4j-1.2.16.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-client-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/regexp-1.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/jpam-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-io-2.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/asm-tree-3.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/jdo-api-3.0.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/ranger-plugin-classloader-0.5.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/xz-1.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/joda-time-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/jta-1.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-vfs2-2.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/ST4-4.0.4.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-shims-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/accumulo-trace-1.7.0.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/netty-3.7.0.Final.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-common-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/servlet-api-2.5.jar,/usr/hdp/2.4.0.0-169/hive/lib/curator-recipes-2.6.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/commons-lang-2.6.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-service-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169-standalone.jar,/usr/hdp/2.4.0.0-169/hive/lib/paranamer-2.3.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-jdbc-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/ant-1.9.1.jar,/usr/hdp/2.4.0.0-169/hive/lib/jsr305-3.0.0.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-hbase-handler-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/guava-14.0.1.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:48:32,457 INFO [pool-5-thread-10] common.AbstractHadoopJob:199 : Hive Dependencies After Filtered: /usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:48:32,457 INFO [pool-5-thread-10] common.AbstractHadoopJob:336 : Job 'tmpjars' updated -- file:/usr/hdp/2.4.0.0-169/hive/lib/hive-metastore-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive/lib/hive-exec-1.2.1000.2.4.0.0-169.jar,file:/usr/hdp/2.4.0.0-169/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.4.0.0-169.jar 2016-08-15 09:48:32,459 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-995dc7a2-30b8-401f-ab72-a23fb43ed668/Streaming_Cube/cuboid 2016-08-15 09:48:32,461 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-e7276b09-2f70-4cab-bf58-c619793919ee/Streaming_Cube/cuboid 2016-08-15 09:48:32,463 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-a3c469b5-5c97-41ea-8ac8-317d1d4f7660/Streaming_Cube/cuboid 2016-08-15 09:48:32,465 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-507ed5ec-8261-412b-9dc8-4c553ac5e300/Streaming_Cube/cuboid 2016-08-15 09:48:32,467 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-24a778e4-c169-4d2f-847d-5322830c8b8e/Streaming_Cube/cuboid 2016-08-15 09:48:32,468 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-70dfc307-a092-4eae-ac1c-d4fdaafbfb4a/Streaming_Cube/cuboid 2016-08-15 09:48:32,471 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-a731291c-ed92-47e6-82f3-9669e0a583a9/Streaming_Cube/cuboid 2016-08-15 09:48:32,473 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-5f3603eb-a545-4651-843a-cacd3945d464/Streaming_Cube/cuboid 2016-08-15 09:48:32,475 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-78a8c843-2d2f-4355-8384-45417f4ceacf/Streaming_Cube/cuboid 2016-08-15 09:48:32,477 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-fb778e8d-57cd-4c37-815b-515f4e5ac08e/Streaming_Cube/cuboid 2016-08-15 09:48:32,479 DEBUG [pool-5-thread-10] common.AbstractHadoopJob:390 : Add input /kylin/kylin_metadata/kylin-f0bdc76b-93d1-47bf-81e1-2dfdb000eb84/Streaming_Cube/cuboid 2016-08-15 09:48:32,480 INFO [pool-5-thread-10] common.KylinConfig:118 : The URI /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta is recognized as LOCAL_FOLDER 2016-08-15 09:48:32,480 INFO [pool-5-thread-10] common.KylinConfigBase:110 : Kylin Config was updated with kylin.metadata.url : /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta 2016-08-15 09:48:32,480 INFO [pool-5-thread-10] persistence.ResourceStore:82 : Using metadata url /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta for resource store 2016-08-15 09:48:32,483 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /cube/Streaming_Cube.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,485 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /model_desc/Streaming_Model.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,487 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /cube_desc/Streaming_Cube.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,490 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /table/DEFAULT.STREAMING_SALES_TABLE.json (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,492 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,496 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,498 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,500 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,502 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,505 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,507 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,509 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,511 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,513 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,515 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,517 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,519 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,521 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,523 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,525 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,528 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,530 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,532 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,534 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,537 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,539 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,541 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,543 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,545 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,547 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,549 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,551 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,554 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,556 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,558 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,560 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,562 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,564 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,566 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,569 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,571 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,573 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,575 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,577 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DAY_START/70793a53-a7f0-4c34-85cd-09df2d8808fc.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,579 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/MINUTE_START/948d0d9a-6dd9-4136-a944-1b02038c1938.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,582 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/ORDER_TIME/6d31640a-7985-4e70-a1ee-b0c5edf892c4.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,584 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/HOUR_START/aec2096f-94cd-4ca3-8a45-56c8f844d51a.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,586 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/COUNTRY/638c607a-5959-459e-ab64-eb1268b7a238.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,588 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CURRENCY/f4607d3e-7da9-4f78-b999-33019bcaee37.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,590 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/DEVICE/d7f2b247-3282-4064-90dd-a37c24595b6f.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,592 DEBUG [pool-5-thread-10] persistence.ResourceStore:209 : Directly saving resource /dict/DEFAULT.STREAMING_SALES_TABLE/CATEGORY/7546facb-c25c-44e6-a4e8-3ca5411e63ec.dict (Store /root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta) 2016-08-15 09:48:32,592 INFO [pool-5-thread-10] common.AbstractHadoopJob:472 : HDFS meta dir is: file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta 2016-08-15 09:48:32,593 INFO [pool-5-thread-10] common.AbstractHadoopJob:350 : Job 'tmpfiles' updated -- file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta 2016-08-15 09:48:32,645 INFO [pool-5-thread-10] steps.CuboidJob:213 : Having total map input MB 0 2016-08-15 09:48:32,645 INFO [pool-5-thread-10] steps.CuboidJob:214 : Having level 0, pre-level cuboids 1, this level cuboids 1 2016-08-15 09:48:32,645 INFO [pool-5-thread-10] steps.CuboidJob:215 : Having per reduce MB 500.0, reduce count ratio 1.0 2016-08-15 09:48:32,646 INFO [pool-5-thread-10] steps.CuboidJob:216 : Setting mapred.reduce.tasks=1 2016-08-15 09:48:34,041 INFO [pool-5-thread-10] common.AbstractHadoopJob:479 : tempMetaFileString is : file:///root/apache-kylin-1.5.2.1/bin/../tomcat/temp/kylin_job_meta1762525492578660960/meta 2016-08-15 09:48:34,042 INFO [pool-5-thread-10] execution.AbstractExecutable:221 : kylin.job.yarn.app.rest.check.status.url is not set, read from job configuration 2016-08-15 09:48:34,043 INFO [pool-5-thread-10] execution.AbstractExecutable:237 : yarn.resourcemanager.webapp.address:http://sandbox.hortonworks.com:8088 2016-08-15 09:48:34,049 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:48:34,049 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:48:34,049 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"ACCEPTED","finalStatus":"UNDEFINED","progress":0.0,"trackingUI":"UNASSIGNED","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":223,"allocatedMB":0,"allocatedVCores":0,"runningContainers":0,"memorySeconds":0,"vcoreSeconds":0,"queueUsagePercentage":0.0,"clusterUsagePercentage":0.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":1,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:48:34,050 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:ACCEPTED-UNDEFINED 2016-08-15 09:48:34,056 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254512360, to newTs: 1471254514052, operation result: true 2016-08-15 09:48:44,074 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:48:44,074 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:48:44,074 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":5.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":10246,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":2250,"allocatedVCores":9,"runningContainers":9,"memorySeconds":5493,"vcoreSeconds":17,"queueUsagePercentage":100.0,"clusterUsagePercentage":100.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:48:44,075 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:RUNNING-UNDEFINED 2016-08-15 09:48:44,087 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254514052, to newTs: 1471254524081, operation result: true 2016-08-15 09:48:44,097 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254524081, to newTs: 1471254524089, operation result: true 2016-08-15 09:48:54,165 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:48:54,166 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:48:54,166 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":5.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":20337,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":2250,"allocatedVCores":9,"runningContainers":9,"memorySeconds":28197,"vcoreSeconds":107,"queueUsagePercentage":100.0,"clusterUsagePercentage":100.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:48:54,167 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:RUNNING-UNDEFINED 2016-08-15 09:48:54,185 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254524089, to newTs: 1471254534179, operation result: true 2016-08-15 09:48:58,642 DEBUG [http-bio-7070-exec-5] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 09:49:04,198 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:49:04,198 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:49:04,199 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":5.0,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":30369,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":2250,"allocatedVCores":9,"runningContainers":9,"memorySeconds":50769,"vcoreSeconds":197,"queueUsagePercentage":100.0,"clusterUsagePercentage":100.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":3,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:49:04,200 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:RUNNING-UNDEFINED 2016-08-15 09:49:04,210 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254534179, to newTs: 1471254544205, operation result: true 2016-08-15 09:49:14,222 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:49:14,223 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:49:14,223 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":24.04176,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":40395,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":1750,"allocatedVCores":7,"runningContainers":7,"memorySeconds":72384,"vcoreSeconds":282,"queueUsagePercentage":77.77778,"clusterUsagePercentage":77.77778,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":5},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:49:14,224 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:RUNNING-UNDEFINED 2016-08-15 09:49:14,232 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254544205, to newTs: 1471254554227, operation result: true 2016-08-15 09:49:24,246 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:49:24,247 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:49:24,247 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":33.636364,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":50418,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":1500,"allocatedVCores":6,"runningContainers":6,"memorySeconds":87931,"vcoreSeconds":344,"queueUsagePercentage":66.66667,"clusterUsagePercentage":66.66667,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":5},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:49:24,248 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:RUNNING-UNDEFINED 2016-08-15 09:49:24,259 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254554227, to newTs: 1471254564251, operation result: true 2016-08-15 09:49:28,111 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 1 running, 1 actual running, 0 ready, 46 others 2016-08-15 09:49:34,270 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:49:34,270 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:49:34,270 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"RUNNING","finalStatus":"UNDEFINED","progress":59.545456,"trackingUI":"ApplicationMaster","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":0,"elapsedTime":60441,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":750,"allocatedVCores":3,"runningContainers":3,"memorySeconds":99037,"vcoreSeconds":389,"queueUsagePercentage":33.333336,"clusterUsagePercentage":33.333336,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":1,"priority":{"priority":5},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:49:34,271 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:RUNNING-UNDEFINED 2016-08-15 09:49:34,276 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254564251, to newTs: 1471254574273, operation result: true 2016-08-15 09:49:44,283 WARN [pool-5-thread-10] httpclient.HttpMethodBase:682 : Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-08-15 09:49:44,283 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:209 : Job job_1471242907167_0043 get status check result. 2016-08-15 09:49:44,283 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:72 : Hadoop job job_1471242907167_0043 status : {"app":{"id":"application_1471242907167_0043","user":"root","name":"Kylin_Merge_Cuboid_Streaming_Cube_Step","queue":"default","state":"FINISHED","finalStatus":"FAILED","progress":100.0,"trackingUI":"History","trackingUrl":"http://sandbox.hortonworks.com:8088/proxy/application_1471242907167_0043/","diagnostics":"","clusterId":1471242907167,"applicationType":"MAPREDUCE","applicationTags":"","startedTime":1471254513824,"finishedTime":1471254579548,"elapsedTime":65724,"amContainerLogs":"http://sandbox.hortonworks.com:8042/node/containerlogs/container_e08_1471242907167_0043_01_000001/root","amHostHttpAddress":"sandbox.hortonworks.com:8042","allocatedMB":250,"allocatedVCores":1,"runningContainers":1,"memorySeconds":104348,"vcoreSeconds":409,"queueUsagePercentage":11.111112,"clusterUsagePercentage":11.111112,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":5},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":10},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"*"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"sandbox.hortonworks.com"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":20},"relaxLocality":true,"resourceName":"/default-rack"},{"capability":{"memory":250,"virtualCores":1},"nodeLabelExpression":"","numContainers":0,"priority":{"priority":0},"relaxLocality":true,"resourceName":"*"}],"logAggregationStatus":"NOT_START"}} 2016-08-15 09:49:44,284 DEBUG [pool-5-thread-10] common.HadoopStatusChecker:59 : State of Hadoop job: job_1471242907167_0043:FINISHED-FAILED 2016-08-15 09:49:44,290 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254574273, to newTs: 1471254584286, operation result: true 2016-08-15 09:49:44,437 WARN [pool-5-thread-10] common.HadoopCmdOutput:89 : no counters for job job_1471242907167_0043 2016-08-15 09:49:44,447 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254584286, to newTs: 1471254584441, operation result: true 2016-08-15 09:49:44,464 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254584441, to newTs: 1471254584450, operation result: true 2016-08-15 09:49:44,478 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from oldTs: 1471254584450, to newTs: 1471254584469, operation result: true 2016-08-15 09:49:44,478 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282-03 from RUNNING to ERROR 2016-08-15 09:49:44,535 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254512335, to newTs: 1471254584531, operation result: true 2016-08-15 09:49:44,542 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254584531, to newTs: 1471254584539, operation result: true 2016-08-15 09:49:44,549 DEBUG [pool-5-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/8f86f44c-ccbd-4368-a2fe-6976e4a10282 from oldTs: 1471254584539, to newTs: 1471254584545, operation result: true 2016-08-15 09:49:44,549 INFO [pool-5-thread-10] manager.ExecutableManager:274 : job id:8f86f44c-ccbd-4368-a2fe-6976e4a10282 from RUNNING to ERROR 2016-08-15 09:49:44,549 WARN [pool-5-thread-10] execution.AbstractExecutable:224 : no need to send email, user list is empty 2016-08-15 09:49:44,674 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:50:28,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:51:27,995 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:52:27,996 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:53:27,997 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:53:42,278 DEBUG [http-bio-7070-exec-4] controller.UserController:64 : authentication.getPrincipal() is org.springframework.security.core.userdetails.User@3b40b2f: Username: ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER 2016-08-15 09:53:42,292 DEBUG [http-bio-7070-exec-4] badquery.BadQueryHistoryManager:84 : Loaded 0 Bad Query(s) 2016-08-15 09:54:28,004 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:55:28,221 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:56:28,035 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:57:27,991 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:58:28,004 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 09:59:28,033 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:00:28,028 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:01:28,027 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:02:27,989 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:03:28,008 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:04:28,027 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:05:28,059 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:06:28,091 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:07:28,048 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:08:28,084 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:09:28,062 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:10:28,089 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:11:28,099 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:12:28,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:13:28,077 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:14:28,072 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:15:28,415 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:16:28,117 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:17:28,052 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:18:28,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:19:28,052 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:20:28,126 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:21:28,278 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:22:28,063 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:23:28,120 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:24:28,132 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:25:28,212 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:26:28,125 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:27:28,129 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:28:28,153 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:29:28,224 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:30:28,085 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:31:28,091 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:32:28,055 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:33:28,079 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:34:28,060 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:35:28,096 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:36:28,053 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:37:28,067 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:38:28,073 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:39:28,069 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:40:28,078 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:41:28,066 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:42:28,040 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:43:28,089 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:44:28,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:45:28,076 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:46:28,047 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:47:28,041 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:48:28,036 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:49:28,039 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:50:28,064 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:51:28,049 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:52:28,063 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:53:28,023 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:54:28,032 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:55:28,062 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:56:28,148 INFO [pool-4-thread-1] threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, 0 ready, 47 others 2016-08-15 10:57:25,409 DEBUG [Thread-12] threadpool.DefaultScheduler:182 : Closing zk connection