[KYLIN-1060] Kylin building cube job progress status is pending - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: v1.0
Fix Version/s: None
Component/s: Environment , Job Engine
Labels:
None
Environment:
OS- Centos7, Not using any sandboxes like CDH and HDP,
Java version - 1.7
Hadoop Version- 2.7.1
Hive Version - 0.14.0
Hbase version -0.99.2

Flags:

Important

Description

Hi,

I have installed Apache Kylin on top of hadoop cluster in the single machine without using sandbox like CDH and HDP.

Kylin is built sucessfully and i am able to access the Kylin Web UI in the port 7070.

As mentioned in the Docs, i have issued the command /bin/sample.sh
by doing this i can see the tables have been created and also the Cube has been created in the name of kylin_sales_cube.

In the second step when i wanted to rebuild the cube by giving the END DATE value, after pressing the submit button in the JOBS page the status is showing as PENDING.

What is the reason for this, I following lines are in the log files of tomcat folder

I did'nt see any ERRORS in the logs
---------------------------------------------------------------------------------
kylin.log---

usage: java org.apache.catalina.startup.Catalina [ -config

{pathname}

] [ -nonaming ]

{ -help | start | stop }

Oct 07, 2015 4:27:58 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /home/tg1/Videos/hadoop/hadoop-2.7.1/lib/native::/home/tg1/Videos/hadoop/hadoop-2.7.1/lib/native:
Oct 07, 2015 4:27:58 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-bio-7070"]
Oct 07, 2015 4:27:58 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["ajp-bio-9009"]
Oct 07, 2015 4:27:58 PM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 1293 ms
Oct 07, 2015 4:27:58 PM org.apache.catalina.core.StandardService startInternal
INFO: Starting service Catalina
Oct 07, 2015 4:27:58 PM org.apache.catalina.core.StandardEngine startInternal
INFO: Starting Servlet Engine: Apache Tomcat/7.0.59
Oct 07, 2015 4:27:59 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive /home/tg1/Music/kylin-1.0-incubating/tomcat/webapps/kylin.war
Oct 07, 2015 4:28:19 PM org.apache.catalina.startup.TaglibUriRule body
INFO: TLD skipped. URI: urn:com:sun:jersey:api:view is already defined
Oct 07, 2015 4:28:19 PM org.apache.catalina.startup.TaglibUriRule body
INFO: TLD skipped. URI: urn:com:sun:jersey:api:view is already defined
Oct 07, 2015 4:28:19 PM org.apache.catalina.startup.TaglibUriRule body
INFO: TLD skipped. URI: urn:com:sun:jersey:api:view is already defined
Oct 07, 2015 4:28:19 PM org.apache.catalina.startup.TaglibUriRule body
INFO: TLD skipped. URI: urn:com:sun:jersey:api:view is already defined
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/tg1/hadoop-2.7.1/hbase/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/tg1/Videos/hadoop/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/tg1/hadoop-2.7.1/hive/lib/hive-jdbc-0.14.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/tg1/Music/kylin-1.0-incubating/tomcat/webapps/kylin/WEB-INF/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
[localhost-startStop-1]:[2015-10-07 16:28:21,195][WARN][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:532)] - KYLIN_CONF property was not set, will seek KYLIN_HOME env variable
[localhost-startStop-1]:[2015-10-07 16:28:21,275][INFO][org.springframework.core.io.support.PropertiesLoaderSupport.loadProperties(PropertiesLoaderSupport.java:177)] - Loading properties file from resource loaded through InputStream
[localhost-startStop-1]:[2015-10-07 16:28:21,466][WARN][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:532)] - KYLIN_CONF property was not set, will seek KYLIN_HOME env variable
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/tg1/hadoop-2.7.1/hbase/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/tg1/Videos/hadoop/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/tg1/hadoop-2.7.1/hive/lib/hive-jdbc-0.14.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2015-10-07 16:28:22,131 WARN [localhost-startStop-1] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-10-07 16:28:22,366 INFO [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x6e89858e connecting to ZooKeeper ensemble=localhost:2181
2015-10-07 16:28:22,375 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2015-10-07 16:28:22,375 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:host.name=localhost
2015-10-07 16:28:22,375 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:java.version=1.7.0_85
2015-10-07 16:28:22,375 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2015-10-07 16:28:22,375 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.85-2.6.1.2.el7_1.x86_64/jre
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=./bin/../tomcat/temp
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:os.name=Linux
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:os.arch=amd64
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:os.version=3.10.0-229.14.1.el7.x86_64
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:user.name=root
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:user.home=/root
2015-10-07 16:28:22,395 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Client environment:user.dir=/home/tg1/Music/kylin-1.0-incubating
2015-10-07 16:28:22,396 INFO [localhost-startStop-1] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x6e89858e, quorum=localhost:2181, baseZNode=/hbase
2015-10-07 16:28:22,434 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-10-07 16:28:22,440 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
2015-10-07 16:28:22,464 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x15041effb620007, negotiated timeout = 40000
[localhost-startStop-1]:[2015-10-07 16:28:23,295][DEBUG][org.apache.kylin.common.persistence.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:101)] - HTable 'kylin_metadata_acl' already exists
[localhost-startStop-1]:[2015-10-07 16:28:24,388][DEBUG][org.apache.kylin.common.persistence.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:101)] - HTable 'kylin_metadata_user' already exists
[localhost-startStop-1]:[2015-10-07 16:28:24,882][INFO][net.sf.ehcache.pool.sizeof.filter.AnnotationSizeOfFilter.<clinit>(AnnotationSizeOfFilter.java:53)] - Using regular expression provided through VM argument net.sf.ehcache.pool.sizeof.ignore.pattern for IgnoreSizeOf annotation : ^.*cache\..*IgnoreSizeOf$
[localhost-startStop-1]:[2015-10-07 16:28:24,893][INFO][net.sf.ehcache.pool.sizeof.JvmInformation.<clinit>(JvmInformation.java:545)] - Detected JVM data model settings of: Unrecognized 64-Bit JVM
[localhost-startStop-1]:[2015-10-07 16:28:25,199][INFO][net.sf.ehcache.pool.sizeof.AgentLoader.getAgentFile(AgentLoader.java:197)] - Extracted agent jar to temporary file ./bin/../tomcat/temp/ehcache-sizeof-agent6228662724369368993.jar
[localhost-startStop-1]:[2015-10-07 16:28:25,200][INFO][net.sf.ehcache.pool.sizeof.AgentLoader.loadAgent(AgentLoader.java:137)] - Trying to load agent @ ./bin/../tomcat/temp/ehcache-sizeof-agent6228662724369368993.jar
[localhost-startStop-1]:[2015-10-07 16:28:25,252][INFO][net.sf.ehcache.pool.impl.DefaultSizeOfEngine.<init>(DefaultSizeOfEngine.java:113)] - using Agent sizeof engine
[localhost-startStop-1]:[2015-10-07 16:28:25,414][WARN][org.springframework.aop.framework.Cglib2AopProxy.doValidateClass(Cglib2AopProxy.java:255)] - Unable to proxy method [public final org.apache.kylin.common.KylinConfig org.apache.kylin.rest.service.BasicService.getKylinConfig()] because it is final: All calls to this method via a proxy will be routed directly to the proxy.
[localhost-startStop-1]:[2015-10-07 16:28:25,802][INFO][org.apache.kylin.rest.controller.JobController.afterPropertiesSet(JobController.java:78)] - Initializing Job Engine ....
[Thread-8]:[2015-10-07 16:28:26,082][INFO][org.apache.curator.framework.imps.CuratorFrameworkImpl.start(CuratorFrameworkImpl.java:230)] - Starting
2015-10-07 16:28:26,088 INFO [Thread-8] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@45248232
2015-10-07 16:28:26,090 INFO [Thread-8-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-10-07 16:28:26,090 INFO [Thread-8-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session
Exception in thread "Thread-8" java.lang.NoSuchMethodError: org.apache.curator.utils.PathUtils.validatePath(Ljava/lang/String;)V
at org.apache.curator.framework.recipes.locks.LockInternals.<init>(LockInternals.java:102)
at org.apache.curator.framework.recipes.locks.InterProcessMutex.<init>(InterProcessMutex.java:190)
at org.apache.curator.framework.recipes.locks.InterProcessMutex.<init>(InterProcessMutex.java:64)
at org.apache.kylin.common.lock.ZookeeperJobLock.lock(ZookeeperJobLock.java:58)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler.init(DefaultScheduler.java:167)
at org.apache.kylin.rest.controller.JobController$1.run(JobController.java:85)
at java.lang.Thread.run(Thread.java:745)
2015-10-07 16:28:26,129 INFO [Thread-8-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x15041effb620008, negotiated timeout = 40000
[Thread-8-EventThread]:[2015-10-07 16:28:26,133][INFO][org.apache.curator.framework.state.ConnectionStateManager.postState(ConnectionStateManager.java:228)] - State change: CONNECTED
Oct 07, 2015 3:58:27 AM org.apache.catalina.util.SessionIdGeneratorBase createSecureRandom
INFO: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [193] milliseconds.
[localhost-startStop-1]:[2015-10-07 16:28:27,125][DEBUG][org.springframework.web.filter.GenericFilterBean.init(GenericFilterBean.java:172)] - Initializing filter 'loggingFilter'
[localhost-startStop-1]:[2015-10-07 16:28:27,127][DEBUG][org.springframework.web.filter.GenericFilterBean.init(GenericFilterBean.java:197)] - Filter 'loggingFilter' configured successfully
Oct 07, 2015 3:58:27 AM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deployment of web application archive /home/tg1/Music/kylin-1.0-incubating/tomcat/webapps/kylin.war has finished in 28,271 ms
Oct 07, 2015 3:58:27 AM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-bio-7070"]
Oct 07, 2015 3:58:27 AM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["ajp-bio-9009"]
Oct 07, 2015 3:58:27 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 28422 ms
[http-bio-7070-exec-2]:[2015-10-07 16:28:27,696][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)] - Get Kylin Runtime Config
[http-bio-7070-exec-3]:[2015-10-07 16:28:27,735][INFO][org.apache.kylin.metadata.project.ProjectManager.<init>(ProjectManager.java:87)] - Initializing ProjectManager with metadata url kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:27,744][INFO][org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:69)] - Using metadata url kylin_metadata@hbase for resource store
[http-bio-7070-exec-7]:[2015-10-07 16:28:27,745][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-10-07 03:58:27;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-3]:[2015-10-07 16:28:27,956][DEBUG][org.apache.kylin.metadata.project.ProjectManager.reloadAllProjects(ProjectManager.java:102)] - Loading Project from folder kylin_metadata(key='/project')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,047][INFO][org.apache.kylin.metadata.realization.RealizationRegistry.<init>(RealizationRegistry.java:76)] - Initializing RealizationRegistry with metadata url kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,312][INFO][org.reflections.Reflections.scan(Reflections.java:224)] - Reflections took 241 ms to scan 9 urls, producing 156 keys and 455 values
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,322][INFO][org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:123)] - Initializing CubeManager with config kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,354][DEBUG][org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:624)] - Loading Cube from folder kylin_metadata(key='/cube')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,403][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)] - Initializing CubeDescManager with config kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,404][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)] - Reloading Cube Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,471][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllSourceTable(MetadataManager.java:244)] - Reloading SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,569][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllSourceTable(MetadataManager.java:253)] - Loaded 3 SourceTable(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,570][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllSourceTableExd(MetadataManager.java:201)] - Reloading SourceTable exd info from folder kylin_metadata(key='/table_exd')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,579][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllSourceTableExd(MetadataManager.java:210)] - Loaded 0 SourceTable EXD(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,580][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllDataModel(MetadataManager.java:291)] - Reloading DataModel from folder kylin_metadata(key='/model_desc')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,647][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllDataModel(MetadataManager.java:305)] - Loaded 2 DataModel(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,652][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)] - Loaded 1 Cube(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,653][DEBUG][org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:630)] - Loaded 1 Cube(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,655][INFO][org.apache.kylin.invertedindex.IIManager.<init>(IIManager.java:102)] - Initializing IIManager with config kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,666][DEBUG][org.apache.kylin.invertedindex.IIManager.loadAllIIInstance(IIManager.java:266)] - Loading II from folder kylin_metadata(key='/invertedindex')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,666][DEBUG][org.apache.kylin.invertedindex.IIManager.loadAllIIInstance(IIManager.java:272)] - Loaded 0 II(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,668][INFO][org.apache.kylin.storage.hybrid.HybridManager.<init>(HybridManager.java:82)] - Initializing HybridManager with config kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,695][DEBUG][org.apache.kylin.storage.hybrid.HybridManager.loadAllHybridInstance(HybridManager.java:92)] - Loading Hybrid from folder kylin_metadata(key='/hybrid')@kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,695][DEBUG][org.apache.kylin.storage.hybrid.HybridManager.loadAllHybridInstance(HybridManager.java:98)] - Loaded 0 Hybrid(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,696][INFO][org.apache.kylin.metadata.realization.RealizationRegistry.init(RealizationRegistry.java:104)] - RealizationRegistry is

{CUBE=org.apache.kylin.cube.CubeManager@70378ff8, HYBRID=org.apache.kylin.storage.hybrid.HybridManager@4fcd1c56, INVERTED_INDEX=org.apache.kylin.invertedindex.IIManager@22ff7b08}

[http-bio-7070-exec-3]:[2015-10-07 16:28:28,696][DEBUG][org.apache.kylin.metadata.project.ProjectManager.reloadAllProjects(ProjectManager.java:108)] - Loaded 1 Project(s)
[http-bio-7070-exec-3]:[2015-10-07 16:28:28,735][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-10-07 03:58:28;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-3]:[2015-10-07 16:28:39,486][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:39;URI=/kylin/api/user/authentication;METHOD=POST;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-7]:[2015-10-07 16:28:39,535][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:39;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-8]:[2015-10-07 16:28:39,695][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:39;URI=/kylin/api/cubes;METHOD=GET;QUERY_STRING=limit=15&offset=0&projectName=learn_kylin;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-8]:[2015-10-07 16:28:39,971][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:39;URI=/kylin/api/access/CubeInstance/1eaca32a-a33e-4b69-83dd-0bb8b1f8c53b;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-8]:[2015-10-07 16:28:49,895][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:49;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-10]:[2015-10-07 16:28:49,921][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)] - Get Kylin Runtime Config
[http-bio-7070-exec-7]:[2015-10-07 16:28:49,935][DEBUG][org.apache.kylin.rest.service.AdminService.getEnv(AdminService.java:52)] - Get Kylin Runtime environment
[http-bio-7070-exec-10]:[2015-10-07 16:28:49,991][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:49;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-7]:[2015-10-07 16:28:50,078][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:50;URI=/kylin/api/admin/env;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-7]:[2015-10-07 16:28:55,606][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)] - wipe cache type: ALL event:UPDATE name:all
[http-bio-7070-exec-7]:[2015-10-07 16:28:55,674][INFO][org.apache.kylin.rest.service.BasicService.resetOLAPDataSources(BasicService.java:94)] - resetOLAPDataSources is called.
[http-bio-7070-exec-7]:[2015-10-07 16:28:55,694][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)] - clean query cache...
[http-bio-7070-exec-7]:[2015-10-07 16:28:55,696][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:58:55;URI=/kylin/api/cache/all/all/update;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-5]:[2015-10-07 16:29:43,647][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 03:59:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,682][INFO][org.apache.kylin.metadata.project.ProjectManager.<init>(ProjectManager.java:87)] - Initializing ProjectManager with metadata url kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,723][DEBUG][org.apache.kylin.metadata.project.ProjectManager.reloadAllProjects(ProjectManager.java:102)] - Loading Project from folder kylin_metadata(key='/project')@kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,743][INFO][org.apache.kylin.metadata.realization.RealizationRegistry.<init>(RealizationRegistry.java:76)] - Initializing RealizationRegistry with metadata url kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,882][INFO][org.reflections.Reflections.scan(Reflections.java:224)] - Reflections took 135 ms to scan 9 urls, producing 156 keys and 455 values
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,883][INFO][org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:123)] - Initializing CubeManager with config kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,904][DEBUG][org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:624)] - Loading Cube from folder kylin_metadata(key='/cube')@kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,919][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)] - Initializing CubeDescManager with config kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,920][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)] - Reloading Cube Metadata from folder kylin_metadata(key='/cube_desc')@kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:43,959][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllSourceTable(MetadataManager.java:244)] - Reloading SourceTable from folder kylin_metadata(key='/table')@kylin_metadata@hbase
[http-bio-7070-exec-6]:[2015-10-07 16:29:44,082][DEBUG][org.apache.kylin.metadata.MetadataManager.reloadAllSourceTable(MetadataManager.java:253)] - Loaded 3 SourceTable(s)
[http-bio-7070-exec-8]:[2015-10-07 17:07:30,988][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:37:30;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-8]:[2015-10-07 17:07:31,055][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:37:31;URI=/kylin/api/cubes;METHOD=GET;QUERY_STRING=limit=15&offset=0&projectName=learn_kylin;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-4]:[2015-10-07 17:07:31,174][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:37:31;URI=/kylin/api/access/CubeInstance/1eaca32a-a33e-4b69-83dd-0bb8b1f8c53b;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-1]:[2015-10-07 17:10:56,420][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:40:56;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-1]:[2015-10-07 17:10:56,472][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:40:56;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-9]:[2015-10-07 17:10:56,728][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:40:56;URI=/kylin/api/jobs;METHOD=GET;QUERY_STRING=limit=15&offset=0&projectName=learn_kylin;PAYLOAD=;RESP_STATUS=200;
GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-9]:[2015-10-07 17:10:56,728][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)] - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-10-07 04:40:56;URI=/kylin/api/jobs;METHOD=GET;QUERY_STRING=limit=15&offset=0&projectName=learn_kylin;PAYLOAD=;RESP_STATUS=200;
===========================================================

kylin_job.log

[localhost-startStop-1]:[2015-10-07 11:19:08,983][INFO][org.apache.kylin.rest.controller.JobController.afterPropertiesSet(JobController.java:78)] - Initializing Job Engine ....
[http-bio-7070-exec-4]:[2015-10-07 11:19:52,746][INFO][org.apache.kylin.job.manager.ExecutableManager.<init>(ExecutableManager.java:72)] - Using metadata url: kylin_metadata@hbase
[http-bio-7070-exec-4]:[2015-10-07 11:19:52,750][INFO][org.apache.kylin.job.dao.ExecutableDao.<init>(ExecutableDao.java:65)] - Using metadata url: kylin_metadata@hbase
[http-bio-7070-exec-1]:[2015-10-07 14:11:16,113][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)] - job id:bf0063cb-8bcb-4f19-8827-f5685bd47e1f-00 from READY to DISCARDED
[http-bio-7070-exec-1]:[2015-10-07 14:17:30,710][INFO][org.apache.kylin.job.manager.ExecutableManager.<init>(ExecutableManager.java:72)] - Using metadata url: kylin_metadata@hbase
[http-bio-7070-exec-1]:[2015-10-07 14:17:30,717][INFO][org.apache.kylin.job.dao.ExecutableDao.<init>(ExecutableDao.java:65)] - Using metadata url: kylin_metadata@hbase
[http-bio-7070-exec-3]:[2015-10-07 14:18:26,588][INFO][org.apache.kylin.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:77)] - Chosen job conf is : /home/tg1/Music/kylin-1.0-incubating/conf/kylin_job_conf_small.xml
[localhost-startStop-1]:[2015-10-07 14:47:02,334][INFO][org.apache.kylin.rest.controller.JobController.afterPropertiesSet(JobController.java:78)] - Initializing Job Engine ....
[http-bio-7070-exec-9]:[2015-10-07 14:47:49,086][INFO][org.apache.kylin.job.manager.ExecutableManager.<init>(ExecutableManager.java:72)] - Using metadata url: kylin_metadata@hbase
[http-bio-7070-exec-9]:[2015-10-07 14:47:49,089][INFO][org.apache.kylin.job.dao.ExecutableDao.<init>(ExecutableDao.java:65)] - Using metadata url: kylin_metadata@hbase
[http-bio-7070-exec-7]:[2015-10-07 14:48:02,441][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:241)] - job id:0fe34e9b-08b2-44e6-b947-ecca9086aac8-00 from READY to DISCARDED
[http-bio-7070-exec-6]:[2015-10-07 14:48:42,717][INFO][org.apache.kylin.job.engine.JobEngineConfig.getHadoopJobConfFilePath(JobEngineConfig.java:77)] - Chosen job conf is : /home/tg1/Music/kylin-1.0-incubating/conf/kylin_job_conf_small.xml

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

kylin_job.log.2015-10-14
15/Oct/15 07:39
85 kB
Austin Solomon Dsouza
Table schema.png
15/Oct/15 07:34
114 kB
Austin Solomon Dsouza

Activity

People

Assignee:: Qianhao Zhou

Reporter:: Austin Solomon Dsouza

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 07/Oct/15 12:04

Updated:: 09/Aug/17 07:43

Resolved:: 22/Oct/15 03:32