2021-11-12 04:53:01,765 INFO [pool-1-thread-1] application.SparkApplication : Executor task org.apache.kylin.engine.spark.job.CubeBuildJob with args : {"distMetaUrl":"kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta","submitter":"ADMIN","dataRangeEnd":"1328054400000","targetModel":"0928468a-9fab-4185-9a14-6f2e7c74823f","dataRangeStart":"1325376000000","project":"learn_kylin","className":"org.apache.kylin.engine.spark.job.CubeBuildJob","segmentName":"20120101000000_20120201000000","parentId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","jobId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","outputMetaUrl":"kylin_metadata@jdbc,url=jdbc:mysql://localhost:3306/kylin?useSSL=false,username=root,password=******,maxActive=10,maxIdle=10","segmentId":"5a515f3a-3415-5445-2cf2-676e1f8063f8","cuboidsNum":"161","cubeName":"kylin_sales_cube_TestRepartition","jobType":"BUILD","cubeId":"a7c6eead-a7b5-d3ef-44d6-3e772d90b225","segmentIds":"5a515f3a-3415-5445-2cf2-676e1f8063f8"} 2021-11-12 04:53:01,768 INFO [pool-1-thread-1] utils.MetaDumpUtil : Ready to load KylinConfig from uri: kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:53:01,879 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.metadata.url.identifier : kylin_metadata 2021-11-12 04:53:01,883 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.log.spark-executor-properties-file : /opt/kylin/conf/spark-executor-log4j.properties 2021-11-12 04:53:01,884 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.source.provider.0 : org.apache.kylin.engine.spark.source.HiveSource 2021-11-12 04:53:01,889 INFO [pool-1-thread-1] application.SparkApplication : Start set spark conf automatically. 2021-11-12 04:53:02,836 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:02,863 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:02,881 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:02,899 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:02,916 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:02,935 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:02,954 DEBUG [pool-1-thread-1] util.HadoopUtil : Use provider:org.apache.kylin.common.storage.DefaultStorageProvider 2021-11-12 04:53:03,000 INFO [pool-1-thread-1] job.CubeBuildJob : The maximum number of tasks required to run the job is 7.0 2021-11-12 04:53:03,000 INFO [pool-1-thread-1] job.CubeBuildJob : require cores: 2 2021-11-12 04:53:03,035 INFO [pool-1-thread-1] application.SparkApplication : Exist count distinct measure: false 2021-11-12 04:53:03,148 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stdout {"scheduler":{"schedulerInfo":{"type":"capacityScheduler","capacity":100.0,"usedCapacity":0.0,"maxCapacity":100.0,"queueName":"root","queues":{"queue":[{"type":"capacitySchedulerLeafQueueInfo","capacity":100.0,"usedCapacity":0.0,"maxCapacity":100.0,"absoluteCapacity":100.0,"absoluteMaxCapacity":100.0,"absoluteUsedCapacity":0.0,"numApplications":0,"queueName":"default","state":"RUNNING","resourcesUsed":{"memory":0,"vCores":0},"hideReservationQueues":false,"nodeLabels":["*"],"numActiveApplications":0,"numPendingApplications":0,"numContainers":0,"maxApplications":10000,"maxApplicationsPerUser":10000,"userLimit":100,"users":null,"userLimitFactor":1.0,"AMResourceLimit":{"memory":5120,"vCores":1},"usedAMResource":{"memory":0,"vCores":0},"userAMResourceLimit":{"memory":5120,"vCores":1},"preemptionDisabled":true}]}}}} 2021-11-12 04:53:03,149 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current 2021-11-12 04:53:03,149 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed 2021-11-12 04:53:03,149 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 2021-11-12 04:53:03,149 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:53:03,149 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 821 0 821 0 0 172k 0 --:--:-- --:--:-- --:--:-- 200k 2021-11-12 04:53:03,150 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler" 2021-11-12 04:53:03,177 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 1.0. 2021-11-12 04:53:03,178 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Current queue used memory is 0, seem available resource as infinite. 2021-11-12 04:53:03,178 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 1.0. 2021-11-12 04:53:03,179 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(2147483647,2147483647),ResourceInfo(2147483647,2147483647)). 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stdout {"scheduler":{"schedulerInfo":{"type":"capacityScheduler","capacity":100.0,"usedCapacity":0.0,"maxCapacity":100.0,"queueName":"root","queues":{"queue":[{"type":"capacitySchedulerLeafQueueInfo","capacity":100.0,"usedCapacity":0.0,"maxCapacity":100.0,"absoluteCapacity":100.0,"absoluteMaxCapacity":100.0,"absoluteUsedCapacity":0.0,"numApplications":0,"queueName":"default","state":"RUNNING","resourcesUsed":{"memory":0,"vCores":0},"hideReservationQueues":false,"nodeLabels":["*"],"numActiveApplications":0,"numPendingApplications":0,"numContainers":0,"maxApplications":10000,"maxApplicationsPerUser":10000,"userLimit":100,"users":null,"userLimitFactor":1.0,"AMResourceLimit":{"memory":5120,"vCores":1},"usedAMResource":{"memory":0,"vCores":0},"userAMResourceLimit":{"memory":5120,"vCores":1},"preemptionDisabled":true}]}}}} 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 821 0 821 0 0 243k 0 --:--:-- --:--:-- --:--:-- 267k 2021-11-12 04:53:03,222 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler" 2021-11-12 04:53:03,224 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 1.0. 2021-11-12 04:53:03,224 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Current queue used memory is 0, seem available resource as infinite. 2021-11-12 04:53:03,224 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 1.0. 2021-11-12 04:53:03,224 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(2147483647,2147483647),ResourceInfo(2147483647,2147483647)). 2021-11-12 04:53:03,225 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: spark.executor.memory = 1GB. 2021-11-12 04:53:03,225 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: count_distinct = false. 2021-11-12 04:53:03,225 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: spark.executor.cores = 1. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: spark.executor.memoryOverhead = 512MB. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: spark.executor.instances = 10. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: spark.yarn.queue = default. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] utils.SparkConfHelper : Auto set spark conf: spark.sql.shuffle.partitions = 2. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.yarn.queue=default. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.history.fs.logDirectory=hdfs:///kylin/spark-history. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.driver.extraJavaOptions=-XX:+CrashOnOutOfMemoryError. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.master=yarn. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.executor.extraJavaOptions=-Dfile.encoding=UTF-8 -Dhdp.version=current -Dlog4j.configuration=spark-executor-log4j.properties -Dlog4j.debug -Dkylin.hdfs.working.dir=hdfs://master/kylin/kylin_metadata/ -Dkylin.metadata.identifier=kylin_metadata -Dkylin.spark.category=job -Dkylin.spark.project=learn_kylin -Dkylin.spark.identifier=866451fe-23f0-4c04-9c9f-53a8ed4aa1be -Dkylin.spark.jobName=866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01 -Duser.timezone=America/New_York. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.hadoop.yarn.timeline-service.enabled=false. 2021-11-12 04:53:03,226 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.eventLog.enabled=true. 2021-11-12 04:53:03,227 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.eventLog.dir=hdfs:///kylin/spark-history. 2021-11-12 04:53:03,227 INFO [pool-1-thread-1] application.SparkApplication : Override user-defined spark conf, set spark.submit.deployMode=client. 2021-11-12 04:53:03,243 INFO [pool-1-thread-1] util.TimeZoneUtils : System timezone set to America/New_York, TimeZoneId: America/New_York. 2021-11-12 04:53:03,243 INFO [pool-1-thread-1] application.SparkApplication : Sleep for random seconds to avoid submitting too many spark job at the same time. 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stdout {"scheduler":{"schedulerInfo":{"type":"capacityScheduler","capacity":100.0,"usedCapacity":0.0,"maxCapacity":100.0,"queueName":"root","queues":{"queue":[{"type":"capacitySchedulerLeafQueueInfo","capacity":100.0,"usedCapacity":0.0,"maxCapacity":100.0,"absoluteCapacity":100.0,"absoluteMaxCapacity":100.0,"absoluteUsedCapacity":0.0,"numApplications":0,"queueName":"default","state":"RUNNING","resourcesUsed":{"memory":0,"vCores":0},"hideReservationQueues":false,"nodeLabels":["*"],"numActiveApplications":0,"numPendingApplications":0,"numContainers":0,"maxApplications":10000,"maxApplicationsPerUser":10000,"userLimit":100,"users":null,"userLimitFactor":1.0,"AMResourceLimit":{"memory":5120,"vCores":1},"usedAMResource":{"memory":0,"vCores":0},"userAMResourceLimit":{"memory":5120,"vCores":1},"preemptionDisabled":true}]}}}} 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 821 0 821 0 0 264k 0 --:--:-- --:--:-- --:--:-- 400k 2021-11-12 04:53:21,485 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler" 2021-11-12 04:53:21,487 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 1.0. 2021-11-12 04:53:21,487 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Current queue used memory is 0, seem available resource as infinite. 2021-11-12 04:53:21,487 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 1.0. 2021-11-12 04:53:21,487 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(2147483647,2147483647),ResourceInfo(2147483647,2147483647)). 2021-11-12 04:53:22,169 INFO [pool-1-thread-1] util.log : Logging initialized @22706ms 2021-11-12 04:53:22,238 INFO [pool-1-thread-1] server.Server : jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown 2021-11-12 04:53:22,256 INFO [pool-1-thread-1] server.Server : Started @22794ms 2021-11-12 04:53:22,279 INFO [pool-1-thread-1] server.AbstractConnector : Started ServerConnector@af0e994{HTTP/1.1,[http/1.1]}{0.0.0.0:4040} 2021-11-12 04:53:22,305 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@7d350be5{/jobs,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,305 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@5d722001{/jobs/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,306 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@3d1574c7{/jobs/job,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,307 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@3efa2ac0{/jobs/job/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,307 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@72446736{/stages,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,308 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@646196f5{/stages/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,308 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@401568a7{/stages/stage,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,309 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@16c4ae40{/stages/stage/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,310 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@7d7fbc6f{/stages/pool,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,310 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@6503c911{/stages/pool/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,311 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@491f8c0c{/storage,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,312 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@7a1a9dc1{/storage/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,312 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@7a06da29{/storage/rdd,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,313 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@1b6df39{/storage/rdd/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,313 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@347c5cef{/environment,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,314 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@1aa63b34{/environment/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,314 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@563d7ddb{/executors,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,315 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@61452f32{/executors/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,316 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@37089cd1{/executors/threadDump,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,316 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@1c5c6e9f{/executors/threadDump/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,326 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@21320b6a{/static,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,326 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@4c74c7d0{/,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,327 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@2e1456d5{/api,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,328 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@ceba79{/jobs/job/kill,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,329 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@3809b6c7{/stages/stage/kill,null,AVAILABLE,@Spark} 2021-11-12 04:53:22,482 INFO [pool-1-thread-1] client.RMProxy : Connecting to ResourceManager at /0.0.0.0:8032 2021-11-12 04:53:22,622 WARN [pool-1-thread-1] yarn.Client : Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME. 2021-11-12 04:53:25,815 INFO [pool-1-thread-1] impl.YarnClientImpl : Submitted application application_1635905980472_0034 2021-11-12 04:53:30,147 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@24bebbad{/metrics/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:36,256 INFO [pool-1-thread-1] client.RMProxy : Connecting to ResourceManager at /0.0.0.0:8032 2021-11-12 04:53:37,390 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@b5b04d9{/SQL,null,AVAILABLE,@Spark} 2021-11-12 04:53:37,391 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@c8a3220{/SQL/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:37,392 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@487c95d2{/SQL/execution,null,AVAILABLE,@Spark} 2021-11-12 04:53:37,392 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@2ac7abb2{/SQL/execution/json,null,AVAILABLE,@Spark} 2021-11-12 04:53:37,394 INFO [pool-1-thread-1] handler.ContextHandler : Started o.s.j.s.ServletContextHandler@77812ce8{/static/sql,null,AVAILABLE,@Spark} 2021-11-12 04:53:37,828 INFO [pool-1-thread-1] job.CubeBuildJob : Start building cube job for 5a515f3a-3415-5445-2cf2-676e1f8063f8 ... 2021-11-12 04:53:37,838 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.CubeManager 2021-11-12 04:53:37,851 INFO [pool-1-thread-1] cube.CubeManager : Initializing CubeManager with config kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:53:37,852 INFO [pool-1-thread-1] persistence.ResourceStore : Using metadata url kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta for resource store 2021-11-12 04:53:37,870 INFO [pool-1-thread-1] persistence.HDFSResourceStore : hdfs meta path : hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:53:37,876 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading CubeInstance from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/cube 2021-11-12 04:53:37,964 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.CubeDescManager 2021-11-12 04:53:37,964 INFO [pool-1-thread-1] cube.CubeDescManager : Initializing CubeDescManager with config kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:53:37,964 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading CubeDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/cube_desc 2021-11-12 04:53:38,006 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.project.ProjectManager 2021-11-12 04:53:38,007 INFO [pool-1-thread-1] project.ProjectManager : Initializing ProjectManager with metadata url kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:53:38,008 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading ProjectInstance from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/project 2021-11-12 04:53:38,019 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 ProjectInstance(s) out of 1 resource with 0 errors 2021-11-12 04:53:38,020 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.cachesync.Broadcaster 2021-11-12 04:53:38,021 DEBUG [pool-1-thread-1] cachesync.Broadcaster : 1 nodes in the cluster: [localhost:7070] 2021-11-12 04:53:38,025 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.model.DataModelManager 2021-11-12 04:53:38,030 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.TableMetadataManager 2021-11-12 04:53:38,030 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading TableDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/table 2021-11-12 04:53:38,070 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering COUNT_DISTINCT(hllc), class org.apache.kylin.measure.hllc.HLLCMeasureType$Factory 2021-11-12 04:53:38,074 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering COUNT_DISTINCT(bitmap), class org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory 2021-11-12 04:53:38,079 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering TOP_N(topn), class org.apache.kylin.measure.topn.TopNMeasureType$Factory 2021-11-12 04:53:38,080 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering RAW(raw), class org.apache.kylin.measure.raw.RawMeasureType$Factory 2021-11-12 04:53:38,081 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering EXTENDED_COLUMN(extendedcolumn), class org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory 2021-11-12 04:53:38,082 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering PERCENTILE_APPROX(percentile), class org.apache.kylin.measure.percentile.PercentileMeasureType$Factory 2021-11-12 04:53:38,083 DEBUG [pool-1-thread-1] measure.MeasureTypeFactory : registering COUNT_DISTINCT(dim_dc), class org.apache.kylin.measure.dim.DimCountDistinctMeasureType$Factory 2021-11-12 04:53:38,085 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 5 TableDesc(s) out of 5 resource with 0 errors 2021-11-12 04:53:38,085 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading TableExtDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/table_exd 2021-11-12 04:53:38,086 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 0 TableExtDesc(s) out of 0 resource with 0 errors 2021-11-12 04:53:38,086 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading ExternalFilterDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/ext_filter 2021-11-12 04:53:38,087 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 0 ExternalFilterDesc(s) out of 0 resource with 0 errors 2021-11-12 04:53:38,087 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading DataModelDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/model_desc 2021-11-12 04:53:38,110 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 DataModelDesc(s) out of 1 resource with 0 errors 2021-11-12 04:53:38,125 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 CubeDesc(s) out of 1 resource with 0 errors 2021-11-12 04:53:38,125 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 CubeInstance(s) out of 1 resource with 0 errors 2021-11-12 04:53:39,804 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2021-11-12 04:53:39,880 INFO [pool-1-thread-1] metastore.ObjectStore : ObjectStore, initialize called 2021-11-12 04:53:40,140 INFO [pool-1-thread-1] DataNucleus.Persistence : Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2021-11-12 04:53:40,140 INFO [pool-1-thread-1] DataNucleus.Persistence : Property datanucleus.cache.level2 unknown - will be ignored 2021-11-12 04:53:40,140 INFO [pool-1-thread-1] DataNucleus.Persistence : Property datanucleus.schema.autoCreateAll unknown - will be ignored 2021-11-12 04:53:41,100 INFO [pool-1-thread-1] metastore.ObjectStore : Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 2021-11-12 04:53:41,825 INFO [pool-1-thread-1] DataNucleus.Datastore : The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 2021-11-12 04:53:41,826 INFO [pool-1-thread-1] DataNucleus.Datastore : The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 2021-11-12 04:53:41,943 INFO [pool-1-thread-1] DataNucleus.Datastore : The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 2021-11-12 04:53:41,943 INFO [pool-1-thread-1] DataNucleus.Datastore : The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 2021-11-12 04:53:42,007 INFO [pool-1-thread-1] DataNucleus.Query : Reading in results for query "org.datanucleus.store.rdbms.query.SQLQuery@0" since the connection used is closing 2021-11-12 04:53:42,010 INFO [pool-1-thread-1] metastore.MetaStoreDirectSql : Using direct SQL, underlying DB is MYSQL 2021-11-12 04:53:42,012 INFO [pool-1-thread-1] metastore.ObjectStore : Initialized ObjectStore 2021-11-12 04:53:42,231 INFO [pool-1-thread-1] metastore.HiveMetaStore : Added admin role in metastore 2021-11-12 04:53:42,233 INFO [pool-1-thread-1] metastore.HiveMetaStore : Added public role in metastore 2021-11-12 04:53:42,279 INFO [pool-1-thread-1] metastore.HiveMetaStore : No user is added in admin role, since config is empty 2021-11-12 04:53:42,383 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_all_databases 2021-11-12 04:53:42,384 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_all_databases 2021-11-12 04:53:42,397 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_functions: db=default pat=* 2021-11-12 04:53:42,397 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_functions: db=default pat=* 2021-11-12 04:53:42,398 INFO [pool-1-thread-1] DataNucleus.Datastore : The class "org.apache.hadoop.hive.metastore.model.MResourceUri" is tagged as "embedded-only" so does not have its own datastore table. 2021-11-12 04:53:42,471 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_functions: db=test pat=* 2021-11-12 04:53:42,471 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_functions: db=test pat=* 2021-11-12 04:53:42,483 INFO [pool-1-thread-1] session.SessionState : Created local directory: /tmp/99bbe3af-a653-459a-9748-431269c2491b_resources 2021-11-12 04:53:42,486 INFO [pool-1-thread-1] session.SessionState : Created HDFS directory: /tmp/hive/root/99bbe3af-a653-459a-9748-431269c2491b 2021-11-12 04:53:42,487 INFO [pool-1-thread-1] session.SessionState : Created local directory: /tmp/root/99bbe3af-a653-459a-9748-431269c2491b 2021-11-12 04:53:42,490 INFO [pool-1-thread-1] session.SessionState : Created HDFS directory: /tmp/hive/root/99bbe3af-a653-459a-9748-431269c2491b/_tmp_space.db 2021-11-12 04:53:42,501 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:42,501 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:42,508 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: global_temp 2021-11-12 04:53:42,508 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: global_temp 2021-11-12 04:53:42,510 WARN [pool-1-thread-1] metastore.ObjectStore : Failed to get database global_temp, returning NoSuchObjectException 2021-11-12 04:53:42,514 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:42,514 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:42,517 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_sales 2021-11-12 04:53:42,518 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_sales 2021-11-12 04:53:42,596 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_sales 2021-11-12 04:53:42,596 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_sales 2021-11-12 04:53:42,971 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select TRANS_ID,PART_DT,LSTG_FORMAT_NAME,LEAF_CATEG_ID,LSTG_SITE_ID,SLR_SEGMENT_CD,PRICE,ITEM_COUNT,SELLER_ID,BUYER_ID,OPS_USER_ID,OPS_REGION,ITEM_ID from DEFAULT.KYLIN_SALES 2021-11-12 04:53:42,972 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- TRANS_ID: long (nullable = true) |-- PART_DT: date (nullable = true) |-- LSTG_FORMAT_NAME: string (nullable = true) |-- LEAF_CATEG_ID: long (nullable = true) |-- LSTG_SITE_ID: integer (nullable = true) |-- SLR_SEGMENT_CD: short (nullable = true) |-- PRICE: decimal(19,4) (nullable = true) |-- ITEM_COUNT: long (nullable = true) |-- SELLER_ID: long (nullable = true) |-- BUYER_ID: long (nullable = true) |-- OPS_USER_ID: string (nullable = true) |-- OPS_REGION: string (nullable = true) |-- ITEM_ID: string (nullable = true) 2021-11-12 04:53:43,016 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- TRANS_ID: long (nullable = true) |-- PART_DT: date (nullable = true) |-- LSTG_FORMAT_NAME: string (nullable = true) |-- LEAF_CATEG_ID: long (nullable = true) |-- LSTG_SITE_ID: integer (nullable = true) |-- SLR_SEGMENT_CD: short (nullable = true) |-- PRICE: decimal(19,4) (nullable = true) |-- ITEM_COUNT: long (nullable = true) |-- SELLER_ID: long (nullable = true) |-- BUYER_ID: long (nullable = true) |-- OPS_USER_ID: string (nullable = true) |-- OPS_REGION: string (nullable = true) |-- ITEM_ID: string (nullable = true) to root |-- KYLIN_SALES_0_DOT_0_TRANS_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_PART_DT: date (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_SITE_ID: integer (nullable = true) |-- KYLIN_SALES_0_DOT_0_SLR_SEGMENT_CD: short (nullable = true) |-- KYLIN_SALES_0_DOT_0_PRICE: decimal(19,4) (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_COUNT: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_SELLER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_BUYER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_USER_ID: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_REGION: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_ID: string (nullable = true) 2021-11-12 04:53:43,017 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_SALES schema root |-- KYLIN_SALES_0_DOT_0_TRANS_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_PART_DT: date (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_SITE_ID: integer (nullable = true) |-- KYLIN_SALES_0_DOT_0_SLR_SEGMENT_CD: short (nullable = true) |-- KYLIN_SALES_0_DOT_0_PRICE: decimal(19,4) (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_COUNT: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_SELLER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_BUYER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_USER_ID: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_REGION: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_ID: string (nullable = true) 2021-11-12 04:53:43,025 INFO [pool-1-thread-1] builder.CreateFlatTable : Create flattable need join lookup tables true, need encode cols false 2021-11-12 04:53:43,026 INFO [pool-1-thread-1] builder.CreateFlatTable : Partition Filter condition is KYLIN_SALES_0_DOT_0_PART_DT >= '2012-01-01' AND KYLIN_SALES_0_DOT_0_PART_DT < '2012-02-01' 2021-11-12 04:53:43,083 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:43,084 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:43,087 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:53:43,088 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:53:43,196 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:53:43,196 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:53:43,265 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select CAL_DT,YEAR_BEG_DT,QTR_BEG_DT,MONTH_BEG_DT,WEEK_BEG_DT,AGE_FOR_YEAR_ID,AGE_FOR_QTR_ID,AGE_FOR_MONTH_ID,AGE_FOR_WEEK_ID,AGE_FOR_DT_ID,AGE_FOR_RTL_YEAR_ID,AGE_FOR_RTL_QTR_ID,AGE_FOR_RTL_MONTH_ID,AGE_FOR_RTL_WEEK_ID,AGE_FOR_CS_WEEK_ID,DAY_OF_CAL_ID,DAY_OF_YEAR_ID,DAY_OF_QTR_ID,DAY_OF_MONTH_ID,DAY_OF_WEEK_ID,WEEK_OF_YEAR_ID,WEEK_OF_CAL_ID,MONTH_OF_QTR_ID,MONTH_OF_YEAR_ID,MONTH_OF_CAL_ID,QTR_OF_YEAR_ID,QTR_OF_CAL_ID,YEAR_OF_CAL_ID,YEAR_END_DT,QTR_END_DT,MONTH_END_DT,WEEK_END_DT,CAL_DT_NAME,CAL_DT_DESC,CAL_DT_SHORT_NAME,YTD_YN_ID,QTD_YN_ID,MTD_YN_ID,WTD_YN_ID,SEASON_BEG_DT,DAY_IN_YEAR_COUNT,DAY_IN_QTR_COUNT,DAY_IN_MONTH_COUNT,DAY_IN_WEEK_COUNT,RTL_YEAR_BEG_DT,RTL_QTR_BEG_DT,RTL_MONTH_BEG_DT,RTL_WEEK_BEG_DT,CS_WEEK_BEG_DT,CAL_DATE,DAY_OF_WEEK,MONTH_ID,PRD_DESC,PRD_FLAG,PRD_ID,PRD_IND,QTR_DESC,QTR_ID,QTR_IND,RETAIL_WEEK,RETAIL_YEAR,RETAIL_START_DATE,RETAIL_WK_END_DATE,WEEK_IND,WEEK_NUM_DESC,WEEK_BEG_DATE,WEEK_END_DATE,WEEK_IN_YEAR_ID,WEEK_ID,WEEK_BEG_END_DESC_MDY,WEEK_BEG_END_DESC_MD,YEAR_ID,YEAR_IND,CAL_DT_MNS_1YEAR_DT,CAL_DT_MNS_2YEAR_DT,CAL_DT_MNS_1QTR_DT,CAL_DT_MNS_2QTR_DT,CAL_DT_MNS_1MONTH_DT,CAL_DT_MNS_2MONTH_DT,CAL_DT_MNS_1WEEK_DT,CAL_DT_MNS_2WEEK_DT,CURR_CAL_DT_MNS_1YEAR_YN_ID,CURR_CAL_DT_MNS_2YEAR_YN_ID,CURR_CAL_DT_MNS_1QTR_YN_ID,CURR_CAL_DT_MNS_2QTR_YN_ID,CURR_CAL_DT_MNS_1MONTH_YN_ID,CURR_CAL_DT_MNS_2MONTH_YN_ID,CURR_CAL_DT_MNS_1WEEK_YN_IND,CURR_CAL_DT_MNS_2WEEK_YN_IND,RTL_MONTH_OF_RTL_YEAR_ID,RTL_QTR_OF_RTL_YEAR_ID,RTL_WEEK_OF_RTL_YEAR_ID,SEASON_OF_YEAR_ID,YTM_YN_ID,YTQ_YN_ID,YTW_YN_ID,KYLIN_CAL_DT_CRE_DATE,KYLIN_CAL_DT_CRE_USER,KYLIN_CAL_DT_UPD_DATE,KYLIN_CAL_DT_UPD_USER from DEFAULT.KYLIN_CAL_DT 2021-11-12 04:53:43,266 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- CAL_DT: date (nullable = true) |-- YEAR_BEG_DT: date (nullable = true) |-- QTR_BEG_DT: date (nullable = true) |-- MONTH_BEG_DT: date (nullable = true) |-- WEEK_BEG_DT: date (nullable = true) |-- AGE_FOR_YEAR_ID: short (nullable = true) |-- AGE_FOR_QTR_ID: short (nullable = true) |-- AGE_FOR_MONTH_ID: short (nullable = true) |-- AGE_FOR_WEEK_ID: short (nullable = true) |-- AGE_FOR_DT_ID: short (nullable = true) |-- AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- DAY_OF_CAL_ID: integer (nullable = true) |-- DAY_OF_YEAR_ID: short (nullable = true) |-- DAY_OF_QTR_ID: short (nullable = true) |-- DAY_OF_MONTH_ID: short (nullable = true) |-- DAY_OF_WEEK_ID: integer (nullable = true) |-- WEEK_OF_YEAR_ID: byte (nullable = true) |-- WEEK_OF_CAL_ID: integer (nullable = true) |-- MONTH_OF_QTR_ID: byte (nullable = true) |-- MONTH_OF_YEAR_ID: byte (nullable = true) |-- MONTH_OF_CAL_ID: short (nullable = true) |-- QTR_OF_YEAR_ID: byte (nullable = true) |-- QTR_OF_CAL_ID: short (nullable = true) |-- YEAR_OF_CAL_ID: short (nullable = true) |-- YEAR_END_DT: string (nullable = true) |-- QTR_END_DT: string (nullable = true) |-- MONTH_END_DT: string (nullable = true) |-- WEEK_END_DT: string (nullable = true) |-- CAL_DT_NAME: string (nullable = true) |-- CAL_DT_DESC: string (nullable = true) |-- CAL_DT_SHORT_NAME: string (nullable = true) |-- YTD_YN_ID: byte (nullable = true) |-- QTD_YN_ID: byte (nullable = true) |-- MTD_YN_ID: byte (nullable = true) |-- WTD_YN_ID: byte (nullable = true) |-- SEASON_BEG_DT: string (nullable = true) |-- DAY_IN_YEAR_COUNT: short (nullable = true) |-- DAY_IN_QTR_COUNT: byte (nullable = true) |-- DAY_IN_MONTH_COUNT: byte (nullable = true) |-- DAY_IN_WEEK_COUNT: byte (nullable = true) |-- RTL_YEAR_BEG_DT: string (nullable = true) |-- RTL_QTR_BEG_DT: string (nullable = true) |-- RTL_MONTH_BEG_DT: string (nullable = true) |-- RTL_WEEK_BEG_DT: string (nullable = true) |-- CS_WEEK_BEG_DT: string (nullable = true) |-- CAL_DATE: string (nullable = true) |-- DAY_OF_WEEK: string (nullable = true) |-- MONTH_ID: string (nullable = true) |-- PRD_DESC: string (nullable = true) |-- PRD_FLAG: string (nullable = true) |-- PRD_ID: string (nullable = true) |-- PRD_IND: string (nullable = true) |-- QTR_DESC: string (nullable = true) |-- QTR_ID: string (nullable = true) |-- QTR_IND: string (nullable = true) |-- RETAIL_WEEK: string (nullable = true) |-- RETAIL_YEAR: string (nullable = true) |-- RETAIL_START_DATE: string (nullable = true) |-- RETAIL_WK_END_DATE: string (nullable = true) |-- WEEK_IND: string (nullable = true) |-- WEEK_NUM_DESC: string (nullable = true) |-- WEEK_BEG_DATE: string (nullable = true) |-- WEEK_END_DATE: string (nullable = true) |-- WEEK_IN_YEAR_ID: string (nullable = true) |-- WEEK_ID: string (nullable = true) |-- WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- WEEK_BEG_END_DESC_MD: string (nullable = true) |-- YEAR_ID: string (nullable = true) |-- YEAR_IND: string (nullable = true) |-- CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- SEASON_OF_YEAR_ID: byte (nullable = true) |-- YTM_YN_ID: byte (nullable = true) |-- YTQ_YN_ID: byte (nullable = true) |-- YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:53:43,317 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- CAL_DT: date (nullable = true) |-- YEAR_BEG_DT: date (nullable = true) |-- QTR_BEG_DT: date (nullable = true) |-- MONTH_BEG_DT: date (nullable = true) |-- WEEK_BEG_DT: date (nullable = true) |-- AGE_FOR_YEAR_ID: short (nullable = true) |-- AGE_FOR_QTR_ID: short (nullable = true) |-- AGE_FOR_MONTH_ID: short (nullable = true) |-- AGE_FOR_WEEK_ID: short (nullable = true) |-- AGE_FOR_DT_ID: short (nullable = true) |-- AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- DAY_OF_CAL_ID: integer (nullable = true) |-- DAY_OF_YEAR_ID: short (nullable = true) |-- DAY_OF_QTR_ID: short (nullable = true) |-- DAY_OF_MONTH_ID: short (nullable = true) |-- DAY_OF_WEEK_ID: integer (nullable = true) |-- WEEK_OF_YEAR_ID: byte (nullable = true) |-- WEEK_OF_CAL_ID: integer (nullable = true) |-- MONTH_OF_QTR_ID: byte (nullable = true) |-- MONTH_OF_YEAR_ID: byte (nullable = true) |-- MONTH_OF_CAL_ID: short (nullable = true) |-- QTR_OF_YEAR_ID: byte (nullable = true) |-- QTR_OF_CAL_ID: short (nullable = true) |-- YEAR_OF_CAL_ID: short (nullable = true) |-- YEAR_END_DT: string (nullable = true) |-- QTR_END_DT: string (nullable = true) |-- MONTH_END_DT: string (nullable = true) |-- WEEK_END_DT: string (nullable = true) |-- CAL_DT_NAME: string (nullable = true) |-- CAL_DT_DESC: string (nullable = true) |-- CAL_DT_SHORT_NAME: string (nullable = true) |-- YTD_YN_ID: byte (nullable = true) |-- QTD_YN_ID: byte (nullable = true) |-- MTD_YN_ID: byte (nullable = true) |-- WTD_YN_ID: byte (nullable = true) |-- SEASON_BEG_DT: string (nullable = true) |-- DAY_IN_YEAR_COUNT: short (nullable = true) |-- DAY_IN_QTR_COUNT: byte (nullable = true) |-- DAY_IN_MONTH_COUNT: byte (nullable = true) |-- DAY_IN_WEEK_COUNT: byte (nullable = true) |-- RTL_YEAR_BEG_DT: string (nullable = true) |-- RTL_QTR_BEG_DT: string (nullable = true) |-- RTL_MONTH_BEG_DT: string (nullable = true) |-- RTL_WEEK_BEG_DT: string (nullable = true) |-- CS_WEEK_BEG_DT: string (nullable = true) |-- CAL_DATE: string (nullable = true) |-- DAY_OF_WEEK: string (nullable = true) |-- MONTH_ID: string (nullable = true) |-- PRD_DESC: string (nullable = true) |-- PRD_FLAG: string (nullable = true) |-- PRD_ID: string (nullable = true) |-- PRD_IND: string (nullable = true) |-- QTR_DESC: string (nullable = true) |-- QTR_ID: string (nullable = true) |-- QTR_IND: string (nullable = true) |-- RETAIL_WEEK: string (nullable = true) |-- RETAIL_YEAR: string (nullable = true) |-- RETAIL_START_DATE: string (nullable = true) |-- RETAIL_WK_END_DATE: string (nullable = true) |-- WEEK_IND: string (nullable = true) |-- WEEK_NUM_DESC: string (nullable = true) |-- WEEK_BEG_DATE: string (nullable = true) |-- WEEK_END_DATE: string (nullable = true) |-- WEEK_IN_YEAR_ID: string (nullable = true) |-- WEEK_ID: string (nullable = true) |-- WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- WEEK_BEG_END_DESC_MD: string (nullable = true) |-- YEAR_ID: string (nullable = true) |-- YEAR_IND: string (nullable = true) |-- CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- SEASON_OF_YEAR_ID: byte (nullable = true) |-- YTM_YN_ID: byte (nullable = true) |-- YTQ_YN_ID: byte (nullable = true) |-- YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_UPD_USER: string (nullable = true) to root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:53:43,319 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_CAL_DT schema root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:53:43,344 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:43,344 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:43,347 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:53:43,348 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:53:43,364 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:53:43,364 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:53:43,395 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select LEAF_CATEG_ID,LEAF_CATEG_NAME,SITE_ID,CATEG_BUSN_MGR,CATEG_BUSN_UNIT,REGN_CATEG,USER_DEFINED_FIELD1,USER_DEFINED_FIELD3,KYLIN_GROUPINGS_CRE_DATE,KYLIN_GROUPINGS_UPD_DATE,KYLIN_GROUPINGS_CRE_USER,KYLIN_GROUPINGS_UPD_USER,META_CATEG_ID,META_CATEG_NAME,CATEG_LVL2_ID,CATEG_LVL3_ID,CATEG_LVL4_ID,CATEG_LVL5_ID,CATEG_LVL6_ID,CATEG_LVL7_ID,CATEG_LVL2_NAME,CATEG_LVL3_NAME,CATEG_LVL4_NAME,CATEG_LVL5_NAME,CATEG_LVL6_NAME,CATEG_LVL7_NAME,CATEG_FLAGS,ADULT_CATEG_YN,DOMAIN_ID,USER_DEFINED_FIELD5,VCS_ID,GCS_ID,MOVE_TO,SAP_CATEGORY_ID,SRC_ID,BSNS_VRTCL_NAME from DEFAULT.KYLIN_CATEGORY_GROUPINGS 2021-11-12 04:53:43,395 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- LEAF_CATEG_ID: long (nullable = true) |-- LEAF_CATEG_NAME: string (nullable = true) |-- SITE_ID: integer (nullable = true) |-- CATEG_BUSN_MGR: string (nullable = true) |-- CATEG_BUSN_UNIT: string (nullable = true) |-- REGN_CATEG: string (nullable = true) |-- USER_DEFINED_FIELD1: string (nullable = true) |-- USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- META_CATEG_ID: decimal(19,4) (nullable = true) |-- META_CATEG_NAME: string (nullable = true) |-- CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL2_NAME: string (nullable = true) |-- CATEG_LVL3_NAME: string (nullable = true) |-- CATEG_LVL4_NAME: string (nullable = true) |-- CATEG_LVL5_NAME: string (nullable = true) |-- CATEG_LVL6_NAME: string (nullable = true) |-- CATEG_LVL7_NAME: string (nullable = true) |-- CATEG_FLAGS: decimal(19,4) (nullable = true) |-- ADULT_CATEG_YN: string (nullable = true) |-- DOMAIN_ID: decimal(19,4) (nullable = true) |-- USER_DEFINED_FIELD5: string (nullable = true) |-- VCS_ID: decimal(19,4) (nullable = true) |-- GCS_ID: decimal(19,4) (nullable = true) |-- MOVE_TO: decimal(19,4) (nullable = true) |-- SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- SRC_ID: byte (nullable = true) |-- BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:53:43,421 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- LEAF_CATEG_ID: long (nullable = true) |-- LEAF_CATEG_NAME: string (nullable = true) |-- SITE_ID: integer (nullable = true) |-- CATEG_BUSN_MGR: string (nullable = true) |-- CATEG_BUSN_UNIT: string (nullable = true) |-- REGN_CATEG: string (nullable = true) |-- USER_DEFINED_FIELD1: string (nullable = true) |-- USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- META_CATEG_ID: decimal(19,4) (nullable = true) |-- META_CATEG_NAME: string (nullable = true) |-- CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL2_NAME: string (nullable = true) |-- CATEG_LVL3_NAME: string (nullable = true) |-- CATEG_LVL4_NAME: string (nullable = true) |-- CATEG_LVL5_NAME: string (nullable = true) |-- CATEG_LVL6_NAME: string (nullable = true) |-- CATEG_LVL7_NAME: string (nullable = true) |-- CATEG_FLAGS: decimal(19,4) (nullable = true) |-- ADULT_CATEG_YN: string (nullable = true) |-- DOMAIN_ID: decimal(19,4) (nullable = true) |-- USER_DEFINED_FIELD5: string (nullable = true) |-- VCS_ID: decimal(19,4) (nullable = true) |-- GCS_ID: decimal(19,4) (nullable = true) |-- MOVE_TO: decimal(19,4) (nullable = true) |-- SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- SRC_ID: byte (nullable = true) |-- BSNS_VRTCL_NAME: string (nullable = true) to root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:53:43,421 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_CATEGORY_GROUPINGS schema root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:53:43,431 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:43,432 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:43,435 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,435 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,450 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,450 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,469 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select ACCOUNT_ID,ACCOUNT_BUYER_LEVEL,ACCOUNT_SELLER_LEVEL,ACCOUNT_COUNTRY,ACCOUNT_CONTACT from DEFAULT.KYLIN_ACCOUNT 2021-11-12 04:53:43,470 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,475 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) to root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,475 INFO [pool-1-thread-1] builder.CreateFlatTable : Table BUYER_ACCOUNT schema root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,479 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:43,479 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:43,483 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,483 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,497 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,497 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:53:43,514 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select ACCOUNT_ID,ACCOUNT_BUYER_LEVEL,ACCOUNT_SELLER_LEVEL,ACCOUNT_COUNTRY,ACCOUNT_CONTACT from DEFAULT.KYLIN_ACCOUNT 2021-11-12 04:53:43,514 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,519 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) to root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,519 INFO [pool-1-thread-1] builder.CreateFlatTable : Table SELLER_ACCOUNT schema root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,523 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:43,524 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:43,527 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,527 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,540 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,540 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,558 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select COUNTRY,LATITUDE,LONGITUDE,NAME from DEFAULT.KYLIN_COUNTRY 2021-11-12 04:53:43,558 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) 2021-11-12 04:53:43,562 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) to root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:53:43,562 INFO [pool-1-thread-1] builder.CreateFlatTable : Table BUYER_COUNTRY schema root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:53:43,565 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:53:43,565 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:53:43,569 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,569 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,582 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,582 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:53:43,599 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select COUNTRY,LATITUDE,LONGITUDE,NAME from DEFAULT.KYLIN_COUNTRY 2021-11-12 04:53:43,599 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) 2021-11-12 04:53:43,603 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) to root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:53:43,603 INFO [pool-1-thread-1] builder.CreateFlatTable : Table SELLER_COUNTRY schema root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:53:43,607 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:53:43,611 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table KYLIN_CAL_DT, condition: (KYLIN_SALES_0_DOT_0_PART_DT = KYLIN_CAL_DT_0_DOT_0_CAL_DT) 2021-11-12 04:53:43,639 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:53:43,640 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table KYLIN_CATEGORY_GROUPINGS, condition: ((KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID) AND (KYLIN_SALES_0_DOT_0_LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID)) 2021-11-12 04:53:43,666 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,666 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table BUYER_ACCOUNT, condition: (KYLIN_SALES_0_DOT_0_BUYER_ID = BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID) 2021-11-12 04:53:43,689 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:53:43,689 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table SELLER_ACCOUNT, condition: (KYLIN_SALES_0_DOT_0_SELLER_ID = SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID) 2021-11-12 04:53:43,710 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:53:43,711 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table BUYER_COUNTRY, condition: (BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY = BUYER_COUNTRY_0_DOT_0_COUNTRY) 2021-11-12 04:53:43,732 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:53:43,732 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table SELLER_COUNTRY, condition: (SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY = SELLER_COUNTRY_0_DOT_0_COUNTRY) 2021-11-12 04:53:43,762 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model column is KYLIN_SALES_0_DOT_0_BUYER_ID AS `17`,KYLIN_SALES_0_DOT_0_SELLER_ID AS `16`,KYLIN_SALES_0_DOT_0_TRANS_ID AS `15`,KYLIN_SALES_0_DOT_0_PART_DT AS `14`,KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID AS `13`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME AS `12`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME AS `11`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME AS `10`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL AS `9`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL AS `8`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `7`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `6`,BUYER_COUNTRY_0_DOT_0_NAME AS `5`,SELLER_COUNTRY_0_DOT_0_NAME AS `4`,KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME AS `3`,KYLIN_SALES_0_DOT_0_LSTG_SITE_ID AS `2`,KYLIN_SALES_0_DOT_0_OPS_USER_ID AS `1`,KYLIN_SALES_0_DOT_0_OPS_REGION AS `0`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `27`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1 AS `22`,KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT AS `18`,BUYER_COUNTRY_0_DOT_0_COUNTRY AS `28`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `26`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID AS `24`,KYLIN_CAL_DT_0_DOT_0_CAL_DT AS `19`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3 AS `25`,KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT AS `20`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID AS `23`,KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT AS `21`,SELLER_COUNTRY_0_DOT_0_COUNTRY AS `29` 2021-11-12 04:53:43,763 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model encoding column is 2021-11-12 04:53:43,764 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model all column is KYLIN_SALES_0_DOT_0_BUYER_ID AS `17`,KYLIN_SALES_0_DOT_0_SELLER_ID AS `16`,KYLIN_SALES_0_DOT_0_TRANS_ID AS `15`,KYLIN_SALES_0_DOT_0_PART_DT AS `14`,KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID AS `13`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME AS `12`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME AS `11`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME AS `10`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL AS `9`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL AS `8`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `7`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `6`,BUYER_COUNTRY_0_DOT_0_NAME AS `5`,SELLER_COUNTRY_0_DOT_0_NAME AS `4`,KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME AS `3`,KYLIN_SALES_0_DOT_0_LSTG_SITE_ID AS `2`,KYLIN_SALES_0_DOT_0_OPS_USER_ID AS `1`,KYLIN_SALES_0_DOT_0_OPS_REGION AS `0`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `27`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1 AS `22`,KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT AS `18`,BUYER_COUNTRY_0_DOT_0_COUNTRY AS `28`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `26`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID AS `24`,KYLIN_CAL_DT_0_DOT_0_CAL_DT AS `19`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3 AS `25`,KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT AS `20`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID AS `23`,KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT AS `21`,SELLER_COUNTRY_0_DOT_0_COUNTRY AS `29` 2021-11-12 04:53:43,774 INFO [pool-1-thread-1] job.ParentSourceChooser : No suitable ready layouts could be reused, generate dataset from flat table. 2021-11-12 04:53:43,775 INFO [pool-1-thread-1] job.ParentSourceChooser : Sampling start ... 2021-11-12 04:53:45,470 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:45,470 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:45,471 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:45,473 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:45,474 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:45,474 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:48,188 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:53:51,022 INFO [pool-1-thread-1] job.ParentSourceChooser : Sampling finished and cost 7 s . 2021-11-12 04:53:51,041 INFO [pool-1-thread-1] job.ParentSourceChooser : Cuboid Statistics results : 16384:31, 16387:93, 16396:183, 16399:309, 16464:192, 16467:334, 16476:397, 16479:434, 16544:188, 16547:325, 16556:388, 16559:433, 16624:345, 16627:416, 16636:435, 16639:449, 17152:319, 17155:402, 17164:434, 17167:451, 17232:434, 17235:446, 17244:460, 17247:460, 17312:431, 17315:450, 17324:457, 17327:458, 17392:451, 17395:452, 17404:457, 17407:458, 20480:285, 20483:379, 20492:412, 20495:442, 20560:424, 20563:446, 20572:452, 20575:454, 20640:425, 20643:447, 20652:449, 20655:455, 20720:449, 20723:458, 20732:454, 20735:455, 21248:442, 21251:454, 21260:459, 21263:459, 21328:452, 21331:457, 21340:459, 21343:461, 21408:454, 21411:457, 21420:462, 21423:460, 21488:456, 21491:456, 21500:456, 21503:458, 22528:395, 22531:440, 22540:448, 22543:454, 22608:443, 22611:460, 22620:458, 22623:457, 22688:452, 22691:458, 22700:454, 22703:456, 22768:459, 22771:459, 22780:458, 22783:462, 23296:451, 23299:457, 23308:460, 23311:460, 23376:458, 23379:459, 23388:461, 23391:455, 23456:458, 23459:457, 23468:457, 23471:459, 23536:458, 23539:457, 23548:458, 23551:461, 23552:422, 23555:447, 23564:453, 23567:456, 23632:453, 23635:455, 23644:459, 23647:459, 23712:454, 23715:453, 23724:453, 23727:455, 23792:453, 23795:455, 23804:456, 23807:460, 24320:454, 24323:458, 24332:458, 24335:457, 24400:461, 24403:460, 24412:459, 24415:459, 24480:459, 24483:461, 24492:459, 24495:459, 24560:458, 24563:463, 24572:453, 24575:458, 31744:425, 31747:446, 31756:451, 31759:455, 31824:455, 31827:456, 31836:460, 31839:462, 31904:451, 31907:457, 31916:456, 31919:455, 31984:457, 31987:459, 31996:455, 31999:457, 32512:460, 32515:457, 32524:460, 32527:461, 32592:461, 32595:460, 32604:459, 32607:460, 32672:456, 32675:455, 32684:456, 32687:456, 32752:459, 32755:459, 32764:460, 32767:458 2021-11-12 04:53:51,042 INFO [pool-1-thread-1] job.CubeBuildJob : Cuboid statistics return 160 records and cost 12861 ms. 2021-11-12 04:53:51,108 INFO [pool-1-thread-1] zlib.ZlibFactory : Successfully loaded & initialized native-zlib library 2021-11-12 04:53:51,108 INFO [pool-1-thread-1] compress.CodecPool : Got brand-new compressor [.deflate] 2021-11-12 04:53:51,225 INFO [pool-1-thread-1] job.CubeBuildJob : kylin_sales_cube_TestRepartition[20120101000000_20120201000000]'s stats saved to resource key(/cube_statistics/kylin_sales_cube_TestRepartition/5a515f3a-3415-5445-2cf2-676e1f8063f8.seq) with path(hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be/cube_statistics/a7c6eead-a7b5-d3ef-44d6-3e772d90b225/5a515f3a-3415-5445-2cf2-676e1f8063f8/cuboid_statistics.seq) 2021-11-12 04:53:51,225 INFO [pool-1-thread-1] common.StatisticsDecisionUtil : It's able to trigger cuboid planner algorithm. 2021-11-12 04:53:51,237 INFO [pool-1-thread-1] common.CubeStatsReader : Reading statistics from file:/tmp/kylin_stats_tmp1821423320717667118.seq 2021-11-12 04:53:51,265 INFO [pool-1-thread-1] compress.CodecPool : Got brand-new decompressor [.deflate] 2021-11-12 04:53:51,312 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.cuboid.CuboidManager 2021-11-12 04:53:51,313 ERROR [pool-1-thread-1] application.SparkApplication : The spark job execute failed! java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:238) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:187) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:183) at org.apache.kylin.engine.mr.common.CuboidRecommenderUtil.getRecommendCuboidList(CuboidRecommenderUtil.java:64) at org.apache.kylin.engine.mr.common.StatisticsDecisionUtil.optimizeCubingPlan(StatisticsDecisionUtil.java:104) at org.apache.kylin.engine.spark.job.CubeBuildJob.doExecute(CubeBuildJob.java:154) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:304) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:93) at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-11-12 04:53:51,315 ERROR [pool-1-thread-1] application.JobMonitor : Job failed the 1 times. java.lang.RuntimeException: Error execute org.apache.kylin.engine.spark.job.CubeBuildJob at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:96) at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:238) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:187) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:183) at org.apache.kylin.engine.mr.common.CuboidRecommenderUtil.getRecommendCuboidList(CuboidRecommenderUtil.java:64) at org.apache.kylin.engine.mr.common.StatisticsDecisionUtil.optimizeCubingPlan(StatisticsDecisionUtil.java:104) at org.apache.kylin.engine.spark.job.CubeBuildJob.doExecute(CubeBuildJob.java:154) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:304) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:93) ... 4 more 2021-11-12 04:53:51,339 INFO [pool-1-thread-1] client.RMProxy : Connecting to ResourceManager at /0.0.0.0:8032 2021-11-12 04:53:51,343 INFO [pool-1-thread-1] cluster.YarnInfoFetcher : Cluster maximum resource allocation ResourceInfo(8182,8) 2021-11-12 04:53:51,369 INFO [pool-1-thread-1] application.SparkApplication : Executor task org.apache.kylin.engine.spark.job.CubeBuildJob with args : {"distMetaUrl":"kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta","submitter":"ADMIN","dataRangeEnd":"1328054400000","targetModel":"0928468a-9fab-4185-9a14-6f2e7c74823f","dataRangeStart":"1325376000000","project":"learn_kylin","className":"org.apache.kylin.engine.spark.job.CubeBuildJob","segmentName":"20120101000000_20120201000000","parentId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","jobId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","outputMetaUrl":"kylin_metadata@jdbc,url=jdbc:mysql://localhost:3306/kylin?useSSL=false,username=root,password=******,maxActive=10,maxIdle=10","segmentId":"5a515f3a-3415-5445-2cf2-676e1f8063f8","cuboidsNum":"161","cubeName":"kylin_sales_cube_TestRepartition","jobType":"BUILD","cubeId":"a7c6eead-a7b5-d3ef-44d6-3e772d90b225","segmentIds":"5a515f3a-3415-5445-2cf2-676e1f8063f8"} 2021-11-12 04:53:51,369 INFO [pool-1-thread-1] utils.MetaDumpUtil : Ready to load KylinConfig from uri: kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:53:51,386 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.metadata.url.identifier : kylin_metadata 2021-11-12 04:53:51,386 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.log.spark-executor-properties-file : /opt/kylin/conf/spark-executor-log4j.properties 2021-11-12 04:53:51,386 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.source.provider.0 : org.apache.kylin.engine.spark.source.HiveSource 2021-11-12 04:53:51,386 INFO [pool-1-thread-1] util.TimeZoneUtils : System timezone set to America/New_York, TimeZoneId: America/New_York. 2021-11-12 04:53:51,386 INFO [pool-1-thread-1] application.SparkApplication : Sleep for random seconds to avoid submitting too many spark job at the same time. 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stdout {"scheduler":{"schedulerInfo":{"type":"capacityScheduler","capacity":100.0,"usedCapacity":48.107384,"maxCapacity":100.0,"queueName":"root","queues":{"queue":[{"type":"capacitySchedulerLeafQueueInfo","capacity":100.0,"usedCapacity":48.107384,"maxCapacity":100.0,"absoluteCapacity":100.0,"absoluteMaxCapacity":100.0,"absoluteUsedCapacity":48.107384,"numApplications":1,"queueName":"default","state":"RUNNING","resourcesUsed":{"memory":21504,"vCores":11},"hideReservationQueues":false,"nodeLabels":["*"],"numActiveApplications":1,"numPendingApplications":0,"numContainers":11,"maxApplications":10000,"maxApplicationsPerUser":10000,"userLimit":100,"users":{"user":[{"username":"root","resourcesUsed":{"memory":21504,"vCores":11},"numPendingApplications":0,"numActiveApplications":1,"AMResourceUsed":{"memory":1024,"vCores":1},"userResourceLimit":{"memory":45056,"vCores":1}}]},"userLimitFactor":1.0,"AMResourceLimit":{"memory":5120,"vCores":1},"usedAMResource":{"memory":1024,"vCores":1},"userAMResourceLimit":{"memory":5120,"vCores":1},"preemptionDisabled":true}]}}}} 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 1064 0 1064 0 0 375k 0 --:--:-- --:--:-- --:--:-- 346k 2021-11-12 04:54:15,715 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler" 2021-11-12 04:54:15,721 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 0.5189261599999999. 2021-11-12 04:54:15,722 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Estimate total cluster resource is ResourceInfo(44699,2147483647). 2021-11-12 04:54:15,722 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 0.5189261599999999. 2021-11-12 04:54:15,722 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(23195,1114385442),ResourceInfo(44699,2147483647)). 2021-11-12 04:54:15,725 WARN [pool-1-thread-1] sql.SparkSession$Builder : Using an existing SparkSession; the static sql configurations will not take effect. 2021-11-12 04:54:15,726 WARN [pool-1-thread-1] sql.SparkSession$Builder : Using an existing SparkSession; some spark core configurations may not take effect. 2021-11-12 04:54:15,743 INFO [pool-1-thread-1] client.RMProxy : Connecting to ResourceManager at /0.0.0.0:8032 2021-11-12 04:54:15,821 INFO [pool-1-thread-1] job.CubeBuildJob : Start building cube job for 5a515f3a-3415-5445-2cf2-676e1f8063f8 ... 2021-11-12 04:54:15,821 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.CubeManager 2021-11-12 04:54:15,821 INFO [pool-1-thread-1] cube.CubeManager : Initializing CubeManager with config kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:15,821 INFO [pool-1-thread-1] persistence.ResourceStore : Using metadata url kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta for resource store 2021-11-12 04:54:15,844 INFO [pool-1-thread-1] persistence.HDFSResourceStore : hdfs meta path : hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:15,846 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading CubeInstance from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/cube 2021-11-12 04:54:15,852 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.CubeDescManager 2021-11-12 04:54:15,852 INFO [pool-1-thread-1] cube.CubeDescManager : Initializing CubeDescManager with config kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:15,852 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading CubeDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/cube_desc 2021-11-12 04:54:15,856 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.project.ProjectManager 2021-11-12 04:54:15,856 INFO [pool-1-thread-1] project.ProjectManager : Initializing ProjectManager with metadata url kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:15,856 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading ProjectInstance from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/project 2021-11-12 04:54:15,859 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 ProjectInstance(s) out of 1 resource with 0 errors 2021-11-12 04:54:15,859 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.cachesync.Broadcaster 2021-11-12 04:54:15,859 DEBUG [pool-1-thread-1] cachesync.Broadcaster : 1 nodes in the cluster: [localhost:7070] 2021-11-12 04:54:15,860 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.model.DataModelManager 2021-11-12 04:54:15,860 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.TableMetadataManager 2021-11-12 04:54:15,860 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading TableDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/table 2021-11-12 04:54:15,870 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 5 TableDesc(s) out of 5 resource with 0 errors 2021-11-12 04:54:15,870 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading TableExtDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/table_exd 2021-11-12 04:54:15,870 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 0 TableExtDesc(s) out of 0 resource with 0 errors 2021-11-12 04:54:15,871 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading ExternalFilterDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/ext_filter 2021-11-12 04:54:15,871 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 0 ExternalFilterDesc(s) out of 0 resource with 0 errors 2021-11-12 04:54:15,871 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading DataModelDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/model_desc 2021-11-12 04:54:15,875 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 DataModelDesc(s) out of 1 resource with 0 errors 2021-11-12 04:54:15,876 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 CubeDesc(s) out of 1 resource with 0 errors 2021-11-12 04:54:15,876 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 CubeInstance(s) out of 1 resource with 0 errors 2021-11-12 04:54:15,903 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:15,903 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:15,907 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_sales 2021-11-12 04:54:15,907 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_sales 2021-11-12 04:54:15,920 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_sales 2021-11-12 04:54:15,920 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_sales 2021-11-12 04:54:15,938 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select TRANS_ID,PART_DT,LSTG_FORMAT_NAME,LEAF_CATEG_ID,LSTG_SITE_ID,SLR_SEGMENT_CD,PRICE,ITEM_COUNT,SELLER_ID,BUYER_ID,OPS_USER_ID,OPS_REGION,ITEM_ID from DEFAULT.KYLIN_SALES 2021-11-12 04:54:15,938 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- TRANS_ID: long (nullable = true) |-- PART_DT: date (nullable = true) |-- LSTG_FORMAT_NAME: string (nullable = true) |-- LEAF_CATEG_ID: long (nullable = true) |-- LSTG_SITE_ID: integer (nullable = true) |-- SLR_SEGMENT_CD: short (nullable = true) |-- PRICE: decimal(19,4) (nullable = true) |-- ITEM_COUNT: long (nullable = true) |-- SELLER_ID: long (nullable = true) |-- BUYER_ID: long (nullable = true) |-- OPS_USER_ID: string (nullable = true) |-- OPS_REGION: string (nullable = true) |-- ITEM_ID: string (nullable = true) 2021-11-12 04:54:15,943 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- TRANS_ID: long (nullable = true) |-- PART_DT: date (nullable = true) |-- LSTG_FORMAT_NAME: string (nullable = true) |-- LEAF_CATEG_ID: long (nullable = true) |-- LSTG_SITE_ID: integer (nullable = true) |-- SLR_SEGMENT_CD: short (nullable = true) |-- PRICE: decimal(19,4) (nullable = true) |-- ITEM_COUNT: long (nullable = true) |-- SELLER_ID: long (nullable = true) |-- BUYER_ID: long (nullable = true) |-- OPS_USER_ID: string (nullable = true) |-- OPS_REGION: string (nullable = true) |-- ITEM_ID: string (nullable = true) to root |-- KYLIN_SALES_0_DOT_0_TRANS_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_PART_DT: date (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_SITE_ID: integer (nullable = true) |-- KYLIN_SALES_0_DOT_0_SLR_SEGMENT_CD: short (nullable = true) |-- KYLIN_SALES_0_DOT_0_PRICE: decimal(19,4) (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_COUNT: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_SELLER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_BUYER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_USER_ID: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_REGION: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_ID: string (nullable = true) 2021-11-12 04:54:15,943 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_SALES schema root |-- KYLIN_SALES_0_DOT_0_TRANS_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_PART_DT: date (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_SITE_ID: integer (nullable = true) |-- KYLIN_SALES_0_DOT_0_SLR_SEGMENT_CD: short (nullable = true) |-- KYLIN_SALES_0_DOT_0_PRICE: decimal(19,4) (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_COUNT: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_SELLER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_BUYER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_USER_ID: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_REGION: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_ID: string (nullable = true) 2021-11-12 04:54:15,945 INFO [pool-1-thread-1] builder.CreateFlatTable : Create flattable need join lookup tables true, need encode cols false 2021-11-12 04:54:15,945 INFO [pool-1-thread-1] builder.CreateFlatTable : Partition Filter condition is KYLIN_SALES_0_DOT_0_PART_DT >= '2012-01-01' AND KYLIN_SALES_0_DOT_0_PART_DT < '2012-02-01' 2021-11-12 04:54:15,954 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:15,954 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:15,957 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:15,957 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:15,973 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:15,973 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:16,003 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select CAL_DT,YEAR_BEG_DT,QTR_BEG_DT,MONTH_BEG_DT,WEEK_BEG_DT,AGE_FOR_YEAR_ID,AGE_FOR_QTR_ID,AGE_FOR_MONTH_ID,AGE_FOR_WEEK_ID,AGE_FOR_DT_ID,AGE_FOR_RTL_YEAR_ID,AGE_FOR_RTL_QTR_ID,AGE_FOR_RTL_MONTH_ID,AGE_FOR_RTL_WEEK_ID,AGE_FOR_CS_WEEK_ID,DAY_OF_CAL_ID,DAY_OF_YEAR_ID,DAY_OF_QTR_ID,DAY_OF_MONTH_ID,DAY_OF_WEEK_ID,WEEK_OF_YEAR_ID,WEEK_OF_CAL_ID,MONTH_OF_QTR_ID,MONTH_OF_YEAR_ID,MONTH_OF_CAL_ID,QTR_OF_YEAR_ID,QTR_OF_CAL_ID,YEAR_OF_CAL_ID,YEAR_END_DT,QTR_END_DT,MONTH_END_DT,WEEK_END_DT,CAL_DT_NAME,CAL_DT_DESC,CAL_DT_SHORT_NAME,YTD_YN_ID,QTD_YN_ID,MTD_YN_ID,WTD_YN_ID,SEASON_BEG_DT,DAY_IN_YEAR_COUNT,DAY_IN_QTR_COUNT,DAY_IN_MONTH_COUNT,DAY_IN_WEEK_COUNT,RTL_YEAR_BEG_DT,RTL_QTR_BEG_DT,RTL_MONTH_BEG_DT,RTL_WEEK_BEG_DT,CS_WEEK_BEG_DT,CAL_DATE,DAY_OF_WEEK,MONTH_ID,PRD_DESC,PRD_FLAG,PRD_ID,PRD_IND,QTR_DESC,QTR_ID,QTR_IND,RETAIL_WEEK,RETAIL_YEAR,RETAIL_START_DATE,RETAIL_WK_END_DATE,WEEK_IND,WEEK_NUM_DESC,WEEK_BEG_DATE,WEEK_END_DATE,WEEK_IN_YEAR_ID,WEEK_ID,WEEK_BEG_END_DESC_MDY,WEEK_BEG_END_DESC_MD,YEAR_ID,YEAR_IND,CAL_DT_MNS_1YEAR_DT,CAL_DT_MNS_2YEAR_DT,CAL_DT_MNS_1QTR_DT,CAL_DT_MNS_2QTR_DT,CAL_DT_MNS_1MONTH_DT,CAL_DT_MNS_2MONTH_DT,CAL_DT_MNS_1WEEK_DT,CAL_DT_MNS_2WEEK_DT,CURR_CAL_DT_MNS_1YEAR_YN_ID,CURR_CAL_DT_MNS_2YEAR_YN_ID,CURR_CAL_DT_MNS_1QTR_YN_ID,CURR_CAL_DT_MNS_2QTR_YN_ID,CURR_CAL_DT_MNS_1MONTH_YN_ID,CURR_CAL_DT_MNS_2MONTH_YN_ID,CURR_CAL_DT_MNS_1WEEK_YN_IND,CURR_CAL_DT_MNS_2WEEK_YN_IND,RTL_MONTH_OF_RTL_YEAR_ID,RTL_QTR_OF_RTL_YEAR_ID,RTL_WEEK_OF_RTL_YEAR_ID,SEASON_OF_YEAR_ID,YTM_YN_ID,YTQ_YN_ID,YTW_YN_ID,KYLIN_CAL_DT_CRE_DATE,KYLIN_CAL_DT_CRE_USER,KYLIN_CAL_DT_UPD_DATE,KYLIN_CAL_DT_UPD_USER from DEFAULT.KYLIN_CAL_DT 2021-11-12 04:54:16,003 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- CAL_DT: date (nullable = true) |-- YEAR_BEG_DT: date (nullable = true) |-- QTR_BEG_DT: date (nullable = true) |-- MONTH_BEG_DT: date (nullable = true) |-- WEEK_BEG_DT: date (nullable = true) |-- AGE_FOR_YEAR_ID: short (nullable = true) |-- AGE_FOR_QTR_ID: short (nullable = true) |-- AGE_FOR_MONTH_ID: short (nullable = true) |-- AGE_FOR_WEEK_ID: short (nullable = true) |-- AGE_FOR_DT_ID: short (nullable = true) |-- AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- DAY_OF_CAL_ID: integer (nullable = true) |-- DAY_OF_YEAR_ID: short (nullable = true) |-- DAY_OF_QTR_ID: short (nullable = true) |-- DAY_OF_MONTH_ID: short (nullable = true) |-- DAY_OF_WEEK_ID: integer (nullable = true) |-- WEEK_OF_YEAR_ID: byte (nullable = true) |-- WEEK_OF_CAL_ID: integer (nullable = true) |-- MONTH_OF_QTR_ID: byte (nullable = true) |-- MONTH_OF_YEAR_ID: byte (nullable = true) |-- MONTH_OF_CAL_ID: short (nullable = true) |-- QTR_OF_YEAR_ID: byte (nullable = true) |-- QTR_OF_CAL_ID: short (nullable = true) |-- YEAR_OF_CAL_ID: short (nullable = true) |-- YEAR_END_DT: string (nullable = true) |-- QTR_END_DT: string (nullable = true) |-- MONTH_END_DT: string (nullable = true) |-- WEEK_END_DT: string (nullable = true) |-- CAL_DT_NAME: string (nullable = true) |-- CAL_DT_DESC: string (nullable = true) |-- CAL_DT_SHORT_NAME: string (nullable = true) |-- YTD_YN_ID: byte (nullable = true) |-- QTD_YN_ID: byte (nullable = true) |-- MTD_YN_ID: byte (nullable = true) |-- WTD_YN_ID: byte (nullable = true) |-- SEASON_BEG_DT: string (nullable = true) |-- DAY_IN_YEAR_COUNT: short (nullable = true) |-- DAY_IN_QTR_COUNT: byte (nullable = true) |-- DAY_IN_MONTH_COUNT: byte (nullable = true) |-- DAY_IN_WEEK_COUNT: byte (nullable = true) |-- RTL_YEAR_BEG_DT: string (nullable = true) |-- RTL_QTR_BEG_DT: string (nullable = true) |-- RTL_MONTH_BEG_DT: string (nullable = true) |-- RTL_WEEK_BEG_DT: string (nullable = true) |-- CS_WEEK_BEG_DT: string (nullable = true) |-- CAL_DATE: string (nullable = true) |-- DAY_OF_WEEK: string (nullable = true) |-- MONTH_ID: string (nullable = true) |-- PRD_DESC: string (nullable = true) |-- PRD_FLAG: string (nullable = true) |-- PRD_ID: string (nullable = true) |-- PRD_IND: string (nullable = true) |-- QTR_DESC: string (nullable = true) |-- QTR_ID: string (nullable = true) |-- QTR_IND: string (nullable = true) |-- RETAIL_WEEK: string (nullable = true) |-- RETAIL_YEAR: string (nullable = true) |-- RETAIL_START_DATE: string (nullable = true) |-- RETAIL_WK_END_DATE: string (nullable = true) |-- WEEK_IND: string (nullable = true) |-- WEEK_NUM_DESC: string (nullable = true) |-- WEEK_BEG_DATE: string (nullable = true) |-- WEEK_END_DATE: string (nullable = true) |-- WEEK_IN_YEAR_ID: string (nullable = true) |-- WEEK_ID: string (nullable = true) |-- WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- WEEK_BEG_END_DESC_MD: string (nullable = true) |-- YEAR_ID: string (nullable = true) |-- YEAR_IND: string (nullable = true) |-- CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- SEASON_OF_YEAR_ID: byte (nullable = true) |-- YTM_YN_ID: byte (nullable = true) |-- YTQ_YN_ID: byte (nullable = true) |-- YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:16,025 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- CAL_DT: date (nullable = true) |-- YEAR_BEG_DT: date (nullable = true) |-- QTR_BEG_DT: date (nullable = true) |-- MONTH_BEG_DT: date (nullable = true) |-- WEEK_BEG_DT: date (nullable = true) |-- AGE_FOR_YEAR_ID: short (nullable = true) |-- AGE_FOR_QTR_ID: short (nullable = true) |-- AGE_FOR_MONTH_ID: short (nullable = true) |-- AGE_FOR_WEEK_ID: short (nullable = true) |-- AGE_FOR_DT_ID: short (nullable = true) |-- AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- DAY_OF_CAL_ID: integer (nullable = true) |-- DAY_OF_YEAR_ID: short (nullable = true) |-- DAY_OF_QTR_ID: short (nullable = true) |-- DAY_OF_MONTH_ID: short (nullable = true) |-- DAY_OF_WEEK_ID: integer (nullable = true) |-- WEEK_OF_YEAR_ID: byte (nullable = true) |-- WEEK_OF_CAL_ID: integer (nullable = true) |-- MONTH_OF_QTR_ID: byte (nullable = true) |-- MONTH_OF_YEAR_ID: byte (nullable = true) |-- MONTH_OF_CAL_ID: short (nullable = true) |-- QTR_OF_YEAR_ID: byte (nullable = true) |-- QTR_OF_CAL_ID: short (nullable = true) |-- YEAR_OF_CAL_ID: short (nullable = true) |-- YEAR_END_DT: string (nullable = true) |-- QTR_END_DT: string (nullable = true) |-- MONTH_END_DT: string (nullable = true) |-- WEEK_END_DT: string (nullable = true) |-- CAL_DT_NAME: string (nullable = true) |-- CAL_DT_DESC: string (nullable = true) |-- CAL_DT_SHORT_NAME: string (nullable = true) |-- YTD_YN_ID: byte (nullable = true) |-- QTD_YN_ID: byte (nullable = true) |-- MTD_YN_ID: byte (nullable = true) |-- WTD_YN_ID: byte (nullable = true) |-- SEASON_BEG_DT: string (nullable = true) |-- DAY_IN_YEAR_COUNT: short (nullable = true) |-- DAY_IN_QTR_COUNT: byte (nullable = true) |-- DAY_IN_MONTH_COUNT: byte (nullable = true) |-- DAY_IN_WEEK_COUNT: byte (nullable = true) |-- RTL_YEAR_BEG_DT: string (nullable = true) |-- RTL_QTR_BEG_DT: string (nullable = true) |-- RTL_MONTH_BEG_DT: string (nullable = true) |-- RTL_WEEK_BEG_DT: string (nullable = true) |-- CS_WEEK_BEG_DT: string (nullable = true) |-- CAL_DATE: string (nullable = true) |-- DAY_OF_WEEK: string (nullable = true) |-- MONTH_ID: string (nullable = true) |-- PRD_DESC: string (nullable = true) |-- PRD_FLAG: string (nullable = true) |-- PRD_ID: string (nullable = true) |-- PRD_IND: string (nullable = true) |-- QTR_DESC: string (nullable = true) |-- QTR_ID: string (nullable = true) |-- QTR_IND: string (nullable = true) |-- RETAIL_WEEK: string (nullable = true) |-- RETAIL_YEAR: string (nullable = true) |-- RETAIL_START_DATE: string (nullable = true) |-- RETAIL_WK_END_DATE: string (nullable = true) |-- WEEK_IND: string (nullable = true) |-- WEEK_NUM_DESC: string (nullable = true) |-- WEEK_BEG_DATE: string (nullable = true) |-- WEEK_END_DATE: string (nullable = true) |-- WEEK_IN_YEAR_ID: string (nullable = true) |-- WEEK_ID: string (nullable = true) |-- WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- WEEK_BEG_END_DESC_MD: string (nullable = true) |-- YEAR_ID: string (nullable = true) |-- YEAR_IND: string (nullable = true) |-- CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- SEASON_OF_YEAR_ID: byte (nullable = true) |-- YTM_YN_ID: byte (nullable = true) |-- YTQ_YN_ID: byte (nullable = true) |-- YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_UPD_USER: string (nullable = true) to root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:16,026 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_CAL_DT schema root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:16,036 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:16,036 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:16,040 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:16,040 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:16,053 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:16,053 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:16,083 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select LEAF_CATEG_ID,LEAF_CATEG_NAME,SITE_ID,CATEG_BUSN_MGR,CATEG_BUSN_UNIT,REGN_CATEG,USER_DEFINED_FIELD1,USER_DEFINED_FIELD3,KYLIN_GROUPINGS_CRE_DATE,KYLIN_GROUPINGS_UPD_DATE,KYLIN_GROUPINGS_CRE_USER,KYLIN_GROUPINGS_UPD_USER,META_CATEG_ID,META_CATEG_NAME,CATEG_LVL2_ID,CATEG_LVL3_ID,CATEG_LVL4_ID,CATEG_LVL5_ID,CATEG_LVL6_ID,CATEG_LVL7_ID,CATEG_LVL2_NAME,CATEG_LVL3_NAME,CATEG_LVL4_NAME,CATEG_LVL5_NAME,CATEG_LVL6_NAME,CATEG_LVL7_NAME,CATEG_FLAGS,ADULT_CATEG_YN,DOMAIN_ID,USER_DEFINED_FIELD5,VCS_ID,GCS_ID,MOVE_TO,SAP_CATEGORY_ID,SRC_ID,BSNS_VRTCL_NAME from DEFAULT.KYLIN_CATEGORY_GROUPINGS 2021-11-12 04:54:16,083 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- LEAF_CATEG_ID: long (nullable = true) |-- LEAF_CATEG_NAME: string (nullable = true) |-- SITE_ID: integer (nullable = true) |-- CATEG_BUSN_MGR: string (nullable = true) |-- CATEG_BUSN_UNIT: string (nullable = true) |-- REGN_CATEG: string (nullable = true) |-- USER_DEFINED_FIELD1: string (nullable = true) |-- USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- META_CATEG_ID: decimal(19,4) (nullable = true) |-- META_CATEG_NAME: string (nullable = true) |-- CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL2_NAME: string (nullable = true) |-- CATEG_LVL3_NAME: string (nullable = true) |-- CATEG_LVL4_NAME: string (nullable = true) |-- CATEG_LVL5_NAME: string (nullable = true) |-- CATEG_LVL6_NAME: string (nullable = true) |-- CATEG_LVL7_NAME: string (nullable = true) |-- CATEG_FLAGS: decimal(19,4) (nullable = true) |-- ADULT_CATEG_YN: string (nullable = true) |-- DOMAIN_ID: decimal(19,4) (nullable = true) |-- USER_DEFINED_FIELD5: string (nullable = true) |-- VCS_ID: decimal(19,4) (nullable = true) |-- GCS_ID: decimal(19,4) (nullable = true) |-- MOVE_TO: decimal(19,4) (nullable = true) |-- SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- SRC_ID: byte (nullable = true) |-- BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:16,097 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- LEAF_CATEG_ID: long (nullable = true) |-- LEAF_CATEG_NAME: string (nullable = true) |-- SITE_ID: integer (nullable = true) |-- CATEG_BUSN_MGR: string (nullable = true) |-- CATEG_BUSN_UNIT: string (nullable = true) |-- REGN_CATEG: string (nullable = true) |-- USER_DEFINED_FIELD1: string (nullable = true) |-- USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- META_CATEG_ID: decimal(19,4) (nullable = true) |-- META_CATEG_NAME: string (nullable = true) |-- CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL2_NAME: string (nullable = true) |-- CATEG_LVL3_NAME: string (nullable = true) |-- CATEG_LVL4_NAME: string (nullable = true) |-- CATEG_LVL5_NAME: string (nullable = true) |-- CATEG_LVL6_NAME: string (nullable = true) |-- CATEG_LVL7_NAME: string (nullable = true) |-- CATEG_FLAGS: decimal(19,4) (nullable = true) |-- ADULT_CATEG_YN: string (nullable = true) |-- DOMAIN_ID: decimal(19,4) (nullable = true) |-- USER_DEFINED_FIELD5: string (nullable = true) |-- VCS_ID: decimal(19,4) (nullable = true) |-- GCS_ID: decimal(19,4) (nullable = true) |-- MOVE_TO: decimal(19,4) (nullable = true) |-- SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- SRC_ID: byte (nullable = true) |-- BSNS_VRTCL_NAME: string (nullable = true) to root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:16,097 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_CATEGORY_GROUPINGS schema root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:16,104 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:16,104 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:16,108 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,109 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,122 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,123 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,141 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select ACCOUNT_ID,ACCOUNT_BUYER_LEVEL,ACCOUNT_SELLER_LEVEL,ACCOUNT_COUNTRY,ACCOUNT_CONTACT from DEFAULT.KYLIN_ACCOUNT 2021-11-12 04:54:16,141 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,145 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) to root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,146 INFO [pool-1-thread-1] builder.CreateFlatTable : Table BUYER_ACCOUNT schema root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,149 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:16,149 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:16,153 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,153 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,167 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,167 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:16,185 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select ACCOUNT_ID,ACCOUNT_BUYER_LEVEL,ACCOUNT_SELLER_LEVEL,ACCOUNT_COUNTRY,ACCOUNT_CONTACT from DEFAULT.KYLIN_ACCOUNT 2021-11-12 04:54:16,185 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,190 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) to root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,190 INFO [pool-1-thread-1] builder.CreateFlatTable : Table SELLER_ACCOUNT schema root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,194 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:16,194 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:16,199 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,199 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,217 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,217 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,237 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select COUNTRY,LATITUDE,LONGITUDE,NAME from DEFAULT.KYLIN_COUNTRY 2021-11-12 04:54:16,237 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) 2021-11-12 04:54:16,241 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) to root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:16,241 INFO [pool-1-thread-1] builder.CreateFlatTable : Table BUYER_COUNTRY schema root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:16,245 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:16,245 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:16,251 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,251 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,269 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,269 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:16,291 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select COUNTRY,LATITUDE,LONGITUDE,NAME from DEFAULT.KYLIN_COUNTRY 2021-11-12 04:54:16,291 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) 2021-11-12 04:54:16,294 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) to root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:16,294 INFO [pool-1-thread-1] builder.CreateFlatTable : Table SELLER_COUNTRY schema root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:16,295 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:16,295 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table KYLIN_CAL_DT, condition: (KYLIN_SALES_0_DOT_0_PART_DT = KYLIN_CAL_DT_0_DOT_0_CAL_DT) 2021-11-12 04:54:16,307 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:16,307 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table KYLIN_CATEGORY_GROUPINGS, condition: ((KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID) AND (KYLIN_SALES_0_DOT_0_LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID)) 2021-11-12 04:54:16,323 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,323 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table BUYER_ACCOUNT, condition: (KYLIN_SALES_0_DOT_0_BUYER_ID = BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID) 2021-11-12 04:54:16,339 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:16,339 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table SELLER_ACCOUNT, condition: (KYLIN_SALES_0_DOT_0_SELLER_ID = SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID) 2021-11-12 04:54:16,356 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:16,356 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table BUYER_COUNTRY, condition: (BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY = BUYER_COUNTRY_0_DOT_0_COUNTRY) 2021-11-12 04:54:16,373 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:16,373 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table SELLER_COUNTRY, condition: (SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY = SELLER_COUNTRY_0_DOT_0_COUNTRY) 2021-11-12 04:54:16,393 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model column is KYLIN_SALES_0_DOT_0_BUYER_ID AS `17`,KYLIN_SALES_0_DOT_0_SELLER_ID AS `16`,KYLIN_SALES_0_DOT_0_TRANS_ID AS `15`,KYLIN_SALES_0_DOT_0_PART_DT AS `14`,KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID AS `13`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME AS `12`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME AS `11`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME AS `10`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL AS `9`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL AS `8`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `7`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `6`,BUYER_COUNTRY_0_DOT_0_NAME AS `5`,SELLER_COUNTRY_0_DOT_0_NAME AS `4`,KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME AS `3`,KYLIN_SALES_0_DOT_0_LSTG_SITE_ID AS `2`,KYLIN_SALES_0_DOT_0_OPS_USER_ID AS `1`,KYLIN_SALES_0_DOT_0_OPS_REGION AS `0`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `27`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1 AS `22`,KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT AS `18`,BUYER_COUNTRY_0_DOT_0_COUNTRY AS `28`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `26`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID AS `24`,KYLIN_CAL_DT_0_DOT_0_CAL_DT AS `19`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3 AS `25`,KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT AS `20`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID AS `23`,KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT AS `21`,SELLER_COUNTRY_0_DOT_0_COUNTRY AS `29` 2021-11-12 04:54:16,393 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model encoding column is 2021-11-12 04:54:16,393 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model all column is KYLIN_SALES_0_DOT_0_BUYER_ID AS `17`,KYLIN_SALES_0_DOT_0_SELLER_ID AS `16`,KYLIN_SALES_0_DOT_0_TRANS_ID AS `15`,KYLIN_SALES_0_DOT_0_PART_DT AS `14`,KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID AS `13`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME AS `12`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME AS `11`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME AS `10`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL AS `9`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL AS `8`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `7`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `6`,BUYER_COUNTRY_0_DOT_0_NAME AS `5`,SELLER_COUNTRY_0_DOT_0_NAME AS `4`,KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME AS `3`,KYLIN_SALES_0_DOT_0_LSTG_SITE_ID AS `2`,KYLIN_SALES_0_DOT_0_OPS_USER_ID AS `1`,KYLIN_SALES_0_DOT_0_OPS_REGION AS `0`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `27`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1 AS `22`,KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT AS `18`,BUYER_COUNTRY_0_DOT_0_COUNTRY AS `28`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `26`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID AS `24`,KYLIN_CAL_DT_0_DOT_0_CAL_DT AS `19`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3 AS `25`,KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT AS `20`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID AS `23`,KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT AS `21`,SELLER_COUNTRY_0_DOT_0_COUNTRY AS `29` 2021-11-12 04:54:16,398 INFO [pool-1-thread-1] job.ParentSourceChooser : No suitable ready layouts could be reused, generate dataset from flat table. 2021-11-12 04:54:16,398 INFO [pool-1-thread-1] job.ParentSourceChooser : Sampling start ... 2021-11-12 04:54:16,697 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:16,698 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:16,705 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:16,706 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:16,713 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:16,737 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:17,198 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:19,933 INFO [pool-1-thread-1] job.ParentSourceChooser : Sampling finished and cost 3 s . 2021-11-12 04:54:19,939 INFO [pool-1-thread-1] job.ParentSourceChooser : Cuboid Statistics results : 16384:31, 16387:93, 16396:183, 16399:309, 16464:192, 16467:334, 16476:397, 16479:434, 16544:188, 16547:325, 16556:388, 16559:433, 16624:345, 16627:416, 16636:435, 16639:449, 17152:319, 17155:402, 17164:434, 17167:451, 17232:434, 17235:446, 17244:460, 17247:460, 17312:431, 17315:450, 17324:457, 17327:458, 17392:451, 17395:452, 17404:457, 17407:458, 20480:285, 20483:379, 20492:412, 20495:442, 20560:424, 20563:446, 20572:452, 20575:454, 20640:425, 20643:447, 20652:449, 20655:455, 20720:449, 20723:458, 20732:454, 20735:455, 21248:442, 21251:454, 21260:459, 21263:459, 21328:452, 21331:457, 21340:459, 21343:461, 21408:454, 21411:457, 21420:462, 21423:460, 21488:456, 21491:456, 21500:456, 21503:458, 22528:395, 22531:440, 22540:448, 22543:454, 22608:443, 22611:460, 22620:458, 22623:457, 22688:452, 22691:458, 22700:454, 22703:456, 22768:459, 22771:459, 22780:458, 22783:462, 23296:451, 23299:457, 23308:460, 23311:460, 23376:458, 23379:459, 23388:461, 23391:455, 23456:458, 23459:457, 23468:457, 23471:459, 23536:458, 23539:457, 23548:458, 23551:461, 23552:422, 23555:447, 23564:453, 23567:456, 23632:453, 23635:455, 23644:459, 23647:459, 23712:454, 23715:453, 23724:453, 23727:455, 23792:453, 23795:455, 23804:456, 23807:460, 24320:454, 24323:458, 24332:458, 24335:457, 24400:461, 24403:460, 24412:459, 24415:459, 24480:459, 24483:461, 24492:459, 24495:459, 24560:458, 24563:463, 24572:453, 24575:458, 31744:425, 31747:446, 31756:451, 31759:455, 31824:455, 31827:456, 31836:460, 31839:462, 31904:451, 31907:457, 31916:456, 31919:455, 31984:457, 31987:459, 31996:455, 31999:457, 32512:460, 32515:457, 32524:460, 32527:461, 32592:461, 32595:460, 32604:459, 32607:460, 32672:456, 32675:455, 32684:456, 32687:456, 32752:459, 32755:459, 32764:460, 32767:458 2021-11-12 04:54:19,939 INFO [pool-1-thread-1] job.CubeBuildJob : Cuboid statistics return 160 records and cost 4055 ms. 2021-11-12 04:54:20,065 INFO [pool-1-thread-1] job.CubeBuildJob : kylin_sales_cube_TestRepartition[20120101000000_20120201000000]'s stats saved to resource key(/cube_statistics/kylin_sales_cube_TestRepartition/5a515f3a-3415-5445-2cf2-676e1f8063f8.seq) with path(hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be/cube_statistics/a7c6eead-a7b5-d3ef-44d6-3e772d90b225/5a515f3a-3415-5445-2cf2-676e1f8063f8/cuboid_statistics.seq) 2021-11-12 04:54:20,065 INFO [pool-1-thread-1] common.StatisticsDecisionUtil : It's able to trigger cuboid planner algorithm. 2021-11-12 04:54:20,071 INFO [pool-1-thread-1] common.CubeStatsReader : Reading statistics from file:/tmp/kylin_stats_tmp8218628186706043146.seq 2021-11-12 04:54:20,124 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.cuboid.CuboidManager 2021-11-12 04:54:20,124 ERROR [pool-1-thread-1] application.SparkApplication : The spark job execute failed! java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:238) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:187) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:183) at org.apache.kylin.engine.mr.common.CuboidRecommenderUtil.getRecommendCuboidList(CuboidRecommenderUtil.java:64) at org.apache.kylin.engine.mr.common.StatisticsDecisionUtil.optimizeCubingPlan(StatisticsDecisionUtil.java:104) at org.apache.kylin.engine.spark.job.CubeBuildJob.doExecute(CubeBuildJob.java:154) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:304) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:93) at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-11-12 04:54:20,124 ERROR [pool-1-thread-1] application.JobMonitor : Job failed the 2 times. java.lang.RuntimeException: Error execute org.apache.kylin.engine.spark.job.CubeBuildJob at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:96) at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:238) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:187) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:183) at org.apache.kylin.engine.mr.common.CuboidRecommenderUtil.getRecommendCuboidList(CuboidRecommenderUtil.java:64) at org.apache.kylin.engine.mr.common.StatisticsDecisionUtil.optimizeCubingPlan(StatisticsDecisionUtil.java:104) at org.apache.kylin.engine.spark.job.CubeBuildJob.doExecute(CubeBuildJob.java:154) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:304) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:93) ... 4 more 2021-11-12 04:54:20,141 INFO [pool-1-thread-1] application.SparkApplication : Executor task org.apache.kylin.engine.spark.job.CubeBuildJob with args : {"distMetaUrl":"kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta","submitter":"ADMIN","dataRangeEnd":"1328054400000","targetModel":"0928468a-9fab-4185-9a14-6f2e7c74823f","dataRangeStart":"1325376000000","project":"learn_kylin","className":"org.apache.kylin.engine.spark.job.CubeBuildJob","segmentName":"20120101000000_20120201000000","parentId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","jobId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","outputMetaUrl":"kylin_metadata@jdbc,url=jdbc:mysql://localhost:3306/kylin?useSSL=false,username=root,password=******,maxActive=10,maxIdle=10","segmentId":"5a515f3a-3415-5445-2cf2-676e1f8063f8","cuboidsNum":"161","cubeName":"kylin_sales_cube_TestRepartition","jobType":"BUILD","cubeId":"a7c6eead-a7b5-d3ef-44d6-3e772d90b225","segmentIds":"5a515f3a-3415-5445-2cf2-676e1f8063f8"} 2021-11-12 04:54:20,141 INFO [pool-1-thread-1] utils.MetaDumpUtil : Ready to load KylinConfig from uri: kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:20,157 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.metadata.url.identifier : kylin_metadata 2021-11-12 04:54:20,157 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.log.spark-executor-properties-file : /opt/kylin/conf/spark-executor-log4j.properties 2021-11-12 04:54:20,157 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.source.provider.0 : org.apache.kylin.engine.spark.source.HiveSource 2021-11-12 04:54:20,157 INFO [pool-1-thread-1] util.TimeZoneUtils : System timezone set to America/New_York, TimeZoneId: America/New_York. 2021-11-12 04:54:20,157 INFO [pool-1-thread-1] application.SparkApplication : Sleep for random seconds to avoid submitting too many spark job at the same time. 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stdout {"scheduler":{"schedulerInfo":{"type":"capacityScheduler","capacity":100.0,"usedCapacity":48.107384,"maxCapacity":100.0,"queueName":"root","queues":{"queue":[{"type":"capacitySchedulerLeafQueueInfo","capacity":100.0,"usedCapacity":48.107384,"maxCapacity":100.0,"absoluteCapacity":100.0,"absoluteMaxCapacity":100.0,"absoluteUsedCapacity":48.107384,"numApplications":1,"queueName":"default","state":"RUNNING","resourcesUsed":{"memory":21504,"vCores":11},"hideReservationQueues":false,"nodeLabels":["*"],"numActiveApplications":1,"numPendingApplications":0,"numContainers":11,"maxApplications":10000,"maxApplicationsPerUser":10000,"userLimit":100,"users":{"user":[{"username":"root","resourcesUsed":{"memory":21504,"vCores":11},"numPendingApplications":0,"numActiveApplications":1,"AMResourceUsed":{"memory":1024,"vCores":1},"userResourceLimit":{"memory":45056,"vCores":1}}]},"userLimitFactor":1.0,"AMResourceLimit":{"memory":5120,"vCores":1},"usedAMResource":{"memory":1024,"vCores":1},"userAMResourceLimit":{"memory":5120,"vCores":1},"preemptionDisabled":true}]}}}} 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 1064 0 1064 0 0 379k 0 --:--:-- --:--:-- --:--:-- 519k 2021-11-12 04:54:39,561 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler" 2021-11-12 04:54:39,567 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 0.5189261599999999. 2021-11-12 04:54:39,567 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Estimate total cluster resource is ResourceInfo(44699,2147483647). 2021-11-12 04:54:39,567 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 0.5189261599999999. 2021-11-12 04:54:39,567 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(23195,1114385442),ResourceInfo(44699,2147483647)). 2021-11-12 04:54:39,568 WARN [pool-1-thread-1] sql.SparkSession$Builder : Using an existing SparkSession; the static sql configurations will not take effect. 2021-11-12 04:54:39,568 WARN [pool-1-thread-1] sql.SparkSession$Builder : Using an existing SparkSession; some spark core configurations may not take effect. 2021-11-12 04:54:39,584 INFO [pool-1-thread-1] client.RMProxy : Connecting to ResourceManager at /0.0.0.0:8032 2021-11-12 04:54:39,597 INFO [pool-1-thread-1] job.CubeBuildJob : Start building cube job for 5a515f3a-3415-5445-2cf2-676e1f8063f8 ... 2021-11-12 04:54:39,597 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.CubeManager 2021-11-12 04:54:39,597 INFO [pool-1-thread-1] cube.CubeManager : Initializing CubeManager with config kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:39,598 INFO [pool-1-thread-1] persistence.ResourceStore : Using metadata url kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta for resource store 2021-11-12 04:54:39,620 INFO [pool-1-thread-1] persistence.HDFSResourceStore : hdfs meta path : hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:39,621 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading CubeInstance from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/cube 2021-11-12 04:54:39,625 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.CubeDescManager 2021-11-12 04:54:39,625 INFO [pool-1-thread-1] cube.CubeDescManager : Initializing CubeDescManager with config kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:39,625 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading CubeDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/cube_desc 2021-11-12 04:54:39,629 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.project.ProjectManager 2021-11-12 04:54:39,629 INFO [pool-1-thread-1] project.ProjectManager : Initializing ProjectManager with metadata url kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:39,629 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading ProjectInstance from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/project 2021-11-12 04:54:39,632 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 ProjectInstance(s) out of 1 resource with 0 errors 2021-11-12 04:54:39,632 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.cachesync.Broadcaster 2021-11-12 04:54:39,633 DEBUG [pool-1-thread-1] cachesync.Broadcaster : 1 nodes in the cluster: [localhost:7070] 2021-11-12 04:54:39,633 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.model.DataModelManager 2021-11-12 04:54:39,633 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.metadata.TableMetadataManager 2021-11-12 04:54:39,633 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading TableDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/table 2021-11-12 04:54:39,642 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 5 TableDesc(s) out of 5 resource with 0 errors 2021-11-12 04:54:39,642 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading TableExtDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/table_exd 2021-11-12 04:54:39,643 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 0 TableExtDesc(s) out of 0 resource with 0 errors 2021-11-12 04:54:39,643 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading ExternalFilterDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/ext_filter 2021-11-12 04:54:39,643 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 0 ExternalFilterDesc(s) out of 0 resource with 0 errors 2021-11-12 04:54:39,643 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Reloading DataModelDesc from hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta/model_desc 2021-11-12 04:54:39,647 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 DataModelDesc(s) out of 1 resource with 0 errors 2021-11-12 04:54:39,648 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 CubeDesc(s) out of 1 resource with 0 errors 2021-11-12 04:54:39,648 DEBUG [pool-1-thread-1] cachesync.CachedCrudAssist : Loaded 1 CubeInstance(s) out of 1 resource with 0 errors 2021-11-12 04:54:39,660 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,660 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,666 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_sales 2021-11-12 04:54:39,666 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_sales 2021-11-12 04:54:39,682 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_sales 2021-11-12 04:54:39,682 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_sales 2021-11-12 04:54:39,697 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select TRANS_ID,PART_DT,LSTG_FORMAT_NAME,LEAF_CATEG_ID,LSTG_SITE_ID,SLR_SEGMENT_CD,PRICE,ITEM_COUNT,SELLER_ID,BUYER_ID,OPS_USER_ID,OPS_REGION,ITEM_ID from DEFAULT.KYLIN_SALES 2021-11-12 04:54:39,697 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- TRANS_ID: long (nullable = true) |-- PART_DT: date (nullable = true) |-- LSTG_FORMAT_NAME: string (nullable = true) |-- LEAF_CATEG_ID: long (nullable = true) |-- LSTG_SITE_ID: integer (nullable = true) |-- SLR_SEGMENT_CD: short (nullable = true) |-- PRICE: decimal(19,4) (nullable = true) |-- ITEM_COUNT: long (nullable = true) |-- SELLER_ID: long (nullable = true) |-- BUYER_ID: long (nullable = true) |-- OPS_USER_ID: string (nullable = true) |-- OPS_REGION: string (nullable = true) |-- ITEM_ID: string (nullable = true) 2021-11-12 04:54:39,701 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- TRANS_ID: long (nullable = true) |-- PART_DT: date (nullable = true) |-- LSTG_FORMAT_NAME: string (nullable = true) |-- LEAF_CATEG_ID: long (nullable = true) |-- LSTG_SITE_ID: integer (nullable = true) |-- SLR_SEGMENT_CD: short (nullable = true) |-- PRICE: decimal(19,4) (nullable = true) |-- ITEM_COUNT: long (nullable = true) |-- SELLER_ID: long (nullable = true) |-- BUYER_ID: long (nullable = true) |-- OPS_USER_ID: string (nullable = true) |-- OPS_REGION: string (nullable = true) |-- ITEM_ID: string (nullable = true) to root |-- KYLIN_SALES_0_DOT_0_TRANS_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_PART_DT: date (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_SITE_ID: integer (nullable = true) |-- KYLIN_SALES_0_DOT_0_SLR_SEGMENT_CD: short (nullable = true) |-- KYLIN_SALES_0_DOT_0_PRICE: decimal(19,4) (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_COUNT: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_SELLER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_BUYER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_USER_ID: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_REGION: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_ID: string (nullable = true) 2021-11-12 04:54:39,701 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_SALES schema root |-- KYLIN_SALES_0_DOT_0_TRANS_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_PART_DT: date (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_LSTG_SITE_ID: integer (nullable = true) |-- KYLIN_SALES_0_DOT_0_SLR_SEGMENT_CD: short (nullable = true) |-- KYLIN_SALES_0_DOT_0_PRICE: decimal(19,4) (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_COUNT: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_SELLER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_BUYER_ID: long (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_USER_ID: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_OPS_REGION: string (nullable = true) |-- KYLIN_SALES_0_DOT_0_ITEM_ID: string (nullable = true) 2021-11-12 04:54:39,703 INFO [pool-1-thread-1] builder.CreateFlatTable : Create flattable need join lookup tables true, need encode cols false 2021-11-12 04:54:39,703 INFO [pool-1-thread-1] builder.CreateFlatTable : Partition Filter condition is KYLIN_SALES_0_DOT_0_PART_DT >= '2012-01-01' AND KYLIN_SALES_0_DOT_0_PART_DT < '2012-02-01' 2021-11-12 04:54:39,708 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,708 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,715 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:39,715 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:39,727 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:39,727 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_cal_dt 2021-11-12 04:54:39,753 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select CAL_DT,YEAR_BEG_DT,QTR_BEG_DT,MONTH_BEG_DT,WEEK_BEG_DT,AGE_FOR_YEAR_ID,AGE_FOR_QTR_ID,AGE_FOR_MONTH_ID,AGE_FOR_WEEK_ID,AGE_FOR_DT_ID,AGE_FOR_RTL_YEAR_ID,AGE_FOR_RTL_QTR_ID,AGE_FOR_RTL_MONTH_ID,AGE_FOR_RTL_WEEK_ID,AGE_FOR_CS_WEEK_ID,DAY_OF_CAL_ID,DAY_OF_YEAR_ID,DAY_OF_QTR_ID,DAY_OF_MONTH_ID,DAY_OF_WEEK_ID,WEEK_OF_YEAR_ID,WEEK_OF_CAL_ID,MONTH_OF_QTR_ID,MONTH_OF_YEAR_ID,MONTH_OF_CAL_ID,QTR_OF_YEAR_ID,QTR_OF_CAL_ID,YEAR_OF_CAL_ID,YEAR_END_DT,QTR_END_DT,MONTH_END_DT,WEEK_END_DT,CAL_DT_NAME,CAL_DT_DESC,CAL_DT_SHORT_NAME,YTD_YN_ID,QTD_YN_ID,MTD_YN_ID,WTD_YN_ID,SEASON_BEG_DT,DAY_IN_YEAR_COUNT,DAY_IN_QTR_COUNT,DAY_IN_MONTH_COUNT,DAY_IN_WEEK_COUNT,RTL_YEAR_BEG_DT,RTL_QTR_BEG_DT,RTL_MONTH_BEG_DT,RTL_WEEK_BEG_DT,CS_WEEK_BEG_DT,CAL_DATE,DAY_OF_WEEK,MONTH_ID,PRD_DESC,PRD_FLAG,PRD_ID,PRD_IND,QTR_DESC,QTR_ID,QTR_IND,RETAIL_WEEK,RETAIL_YEAR,RETAIL_START_DATE,RETAIL_WK_END_DATE,WEEK_IND,WEEK_NUM_DESC,WEEK_BEG_DATE,WEEK_END_DATE,WEEK_IN_YEAR_ID,WEEK_ID,WEEK_BEG_END_DESC_MDY,WEEK_BEG_END_DESC_MD,YEAR_ID,YEAR_IND,CAL_DT_MNS_1YEAR_DT,CAL_DT_MNS_2YEAR_DT,CAL_DT_MNS_1QTR_DT,CAL_DT_MNS_2QTR_DT,CAL_DT_MNS_1MONTH_DT,CAL_DT_MNS_2MONTH_DT,CAL_DT_MNS_1WEEK_DT,CAL_DT_MNS_2WEEK_DT,CURR_CAL_DT_MNS_1YEAR_YN_ID,CURR_CAL_DT_MNS_2YEAR_YN_ID,CURR_CAL_DT_MNS_1QTR_YN_ID,CURR_CAL_DT_MNS_2QTR_YN_ID,CURR_CAL_DT_MNS_1MONTH_YN_ID,CURR_CAL_DT_MNS_2MONTH_YN_ID,CURR_CAL_DT_MNS_1WEEK_YN_IND,CURR_CAL_DT_MNS_2WEEK_YN_IND,RTL_MONTH_OF_RTL_YEAR_ID,RTL_QTR_OF_RTL_YEAR_ID,RTL_WEEK_OF_RTL_YEAR_ID,SEASON_OF_YEAR_ID,YTM_YN_ID,YTQ_YN_ID,YTW_YN_ID,KYLIN_CAL_DT_CRE_DATE,KYLIN_CAL_DT_CRE_USER,KYLIN_CAL_DT_UPD_DATE,KYLIN_CAL_DT_UPD_USER from DEFAULT.KYLIN_CAL_DT 2021-11-12 04:54:39,753 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- CAL_DT: date (nullable = true) |-- YEAR_BEG_DT: date (nullable = true) |-- QTR_BEG_DT: date (nullable = true) |-- MONTH_BEG_DT: date (nullable = true) |-- WEEK_BEG_DT: date (nullable = true) |-- AGE_FOR_YEAR_ID: short (nullable = true) |-- AGE_FOR_QTR_ID: short (nullable = true) |-- AGE_FOR_MONTH_ID: short (nullable = true) |-- AGE_FOR_WEEK_ID: short (nullable = true) |-- AGE_FOR_DT_ID: short (nullable = true) |-- AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- DAY_OF_CAL_ID: integer (nullable = true) |-- DAY_OF_YEAR_ID: short (nullable = true) |-- DAY_OF_QTR_ID: short (nullable = true) |-- DAY_OF_MONTH_ID: short (nullable = true) |-- DAY_OF_WEEK_ID: integer (nullable = true) |-- WEEK_OF_YEAR_ID: byte (nullable = true) |-- WEEK_OF_CAL_ID: integer (nullable = true) |-- MONTH_OF_QTR_ID: byte (nullable = true) |-- MONTH_OF_YEAR_ID: byte (nullable = true) |-- MONTH_OF_CAL_ID: short (nullable = true) |-- QTR_OF_YEAR_ID: byte (nullable = true) |-- QTR_OF_CAL_ID: short (nullable = true) |-- YEAR_OF_CAL_ID: short (nullable = true) |-- YEAR_END_DT: string (nullable = true) |-- QTR_END_DT: string (nullable = true) |-- MONTH_END_DT: string (nullable = true) |-- WEEK_END_DT: string (nullable = true) |-- CAL_DT_NAME: string (nullable = true) |-- CAL_DT_DESC: string (nullable = true) |-- CAL_DT_SHORT_NAME: string (nullable = true) |-- YTD_YN_ID: byte (nullable = true) |-- QTD_YN_ID: byte (nullable = true) |-- MTD_YN_ID: byte (nullable = true) |-- WTD_YN_ID: byte (nullable = true) |-- SEASON_BEG_DT: string (nullable = true) |-- DAY_IN_YEAR_COUNT: short (nullable = true) |-- DAY_IN_QTR_COUNT: byte (nullable = true) |-- DAY_IN_MONTH_COUNT: byte (nullable = true) |-- DAY_IN_WEEK_COUNT: byte (nullable = true) |-- RTL_YEAR_BEG_DT: string (nullable = true) |-- RTL_QTR_BEG_DT: string (nullable = true) |-- RTL_MONTH_BEG_DT: string (nullable = true) |-- RTL_WEEK_BEG_DT: string (nullable = true) |-- CS_WEEK_BEG_DT: string (nullable = true) |-- CAL_DATE: string (nullable = true) |-- DAY_OF_WEEK: string (nullable = true) |-- MONTH_ID: string (nullable = true) |-- PRD_DESC: string (nullable = true) |-- PRD_FLAG: string (nullable = true) |-- PRD_ID: string (nullable = true) |-- PRD_IND: string (nullable = true) |-- QTR_DESC: string (nullable = true) |-- QTR_ID: string (nullable = true) |-- QTR_IND: string (nullable = true) |-- RETAIL_WEEK: string (nullable = true) |-- RETAIL_YEAR: string (nullable = true) |-- RETAIL_START_DATE: string (nullable = true) |-- RETAIL_WK_END_DATE: string (nullable = true) |-- WEEK_IND: string (nullable = true) |-- WEEK_NUM_DESC: string (nullable = true) |-- WEEK_BEG_DATE: string (nullable = true) |-- WEEK_END_DATE: string (nullable = true) |-- WEEK_IN_YEAR_ID: string (nullable = true) |-- WEEK_ID: string (nullable = true) |-- WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- WEEK_BEG_END_DESC_MD: string (nullable = true) |-- YEAR_ID: string (nullable = true) |-- YEAR_IND: string (nullable = true) |-- CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- SEASON_OF_YEAR_ID: byte (nullable = true) |-- YTM_YN_ID: byte (nullable = true) |-- YTQ_YN_ID: byte (nullable = true) |-- YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:39,771 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- CAL_DT: date (nullable = true) |-- YEAR_BEG_DT: date (nullable = true) |-- QTR_BEG_DT: date (nullable = true) |-- MONTH_BEG_DT: date (nullable = true) |-- WEEK_BEG_DT: date (nullable = true) |-- AGE_FOR_YEAR_ID: short (nullable = true) |-- AGE_FOR_QTR_ID: short (nullable = true) |-- AGE_FOR_MONTH_ID: short (nullable = true) |-- AGE_FOR_WEEK_ID: short (nullable = true) |-- AGE_FOR_DT_ID: short (nullable = true) |-- AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- DAY_OF_CAL_ID: integer (nullable = true) |-- DAY_OF_YEAR_ID: short (nullable = true) |-- DAY_OF_QTR_ID: short (nullable = true) |-- DAY_OF_MONTH_ID: short (nullable = true) |-- DAY_OF_WEEK_ID: integer (nullable = true) |-- WEEK_OF_YEAR_ID: byte (nullable = true) |-- WEEK_OF_CAL_ID: integer (nullable = true) |-- MONTH_OF_QTR_ID: byte (nullable = true) |-- MONTH_OF_YEAR_ID: byte (nullable = true) |-- MONTH_OF_CAL_ID: short (nullable = true) |-- QTR_OF_YEAR_ID: byte (nullable = true) |-- QTR_OF_CAL_ID: short (nullable = true) |-- YEAR_OF_CAL_ID: short (nullable = true) |-- YEAR_END_DT: string (nullable = true) |-- QTR_END_DT: string (nullable = true) |-- MONTH_END_DT: string (nullable = true) |-- WEEK_END_DT: string (nullable = true) |-- CAL_DT_NAME: string (nullable = true) |-- CAL_DT_DESC: string (nullable = true) |-- CAL_DT_SHORT_NAME: string (nullable = true) |-- YTD_YN_ID: byte (nullable = true) |-- QTD_YN_ID: byte (nullable = true) |-- MTD_YN_ID: byte (nullable = true) |-- WTD_YN_ID: byte (nullable = true) |-- SEASON_BEG_DT: string (nullable = true) |-- DAY_IN_YEAR_COUNT: short (nullable = true) |-- DAY_IN_QTR_COUNT: byte (nullable = true) |-- DAY_IN_MONTH_COUNT: byte (nullable = true) |-- DAY_IN_WEEK_COUNT: byte (nullable = true) |-- RTL_YEAR_BEG_DT: string (nullable = true) |-- RTL_QTR_BEG_DT: string (nullable = true) |-- RTL_MONTH_BEG_DT: string (nullable = true) |-- RTL_WEEK_BEG_DT: string (nullable = true) |-- CS_WEEK_BEG_DT: string (nullable = true) |-- CAL_DATE: string (nullable = true) |-- DAY_OF_WEEK: string (nullable = true) |-- MONTH_ID: string (nullable = true) |-- PRD_DESC: string (nullable = true) |-- PRD_FLAG: string (nullable = true) |-- PRD_ID: string (nullable = true) |-- PRD_IND: string (nullable = true) |-- QTR_DESC: string (nullable = true) |-- QTR_ID: string (nullable = true) |-- QTR_IND: string (nullable = true) |-- RETAIL_WEEK: string (nullable = true) |-- RETAIL_YEAR: string (nullable = true) |-- RETAIL_START_DATE: string (nullable = true) |-- RETAIL_WK_END_DATE: string (nullable = true) |-- WEEK_IND: string (nullable = true) |-- WEEK_NUM_DESC: string (nullable = true) |-- WEEK_BEG_DATE: string (nullable = true) |-- WEEK_END_DATE: string (nullable = true) |-- WEEK_IN_YEAR_ID: string (nullable = true) |-- WEEK_ID: string (nullable = true) |-- WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- WEEK_BEG_END_DESC_MD: string (nullable = true) |-- YEAR_ID: string (nullable = true) |-- YEAR_IND: string (nullable = true) |-- CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- SEASON_OF_YEAR_ID: byte (nullable = true) |-- YTM_YN_ID: byte (nullable = true) |-- YTQ_YN_ID: byte (nullable = true) |-- YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_UPD_USER: string (nullable = true) to root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:39,771 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_CAL_DT schema root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:39,780 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,780 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,783 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:39,784 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:39,794 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:39,795 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_category_groupings 2021-11-12 04:54:39,812 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select LEAF_CATEG_ID,LEAF_CATEG_NAME,SITE_ID,CATEG_BUSN_MGR,CATEG_BUSN_UNIT,REGN_CATEG,USER_DEFINED_FIELD1,USER_DEFINED_FIELD3,KYLIN_GROUPINGS_CRE_DATE,KYLIN_GROUPINGS_UPD_DATE,KYLIN_GROUPINGS_CRE_USER,KYLIN_GROUPINGS_UPD_USER,META_CATEG_ID,META_CATEG_NAME,CATEG_LVL2_ID,CATEG_LVL3_ID,CATEG_LVL4_ID,CATEG_LVL5_ID,CATEG_LVL6_ID,CATEG_LVL7_ID,CATEG_LVL2_NAME,CATEG_LVL3_NAME,CATEG_LVL4_NAME,CATEG_LVL5_NAME,CATEG_LVL6_NAME,CATEG_LVL7_NAME,CATEG_FLAGS,ADULT_CATEG_YN,DOMAIN_ID,USER_DEFINED_FIELD5,VCS_ID,GCS_ID,MOVE_TO,SAP_CATEGORY_ID,SRC_ID,BSNS_VRTCL_NAME from DEFAULT.KYLIN_CATEGORY_GROUPINGS 2021-11-12 04:54:39,812 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- LEAF_CATEG_ID: long (nullable = true) |-- LEAF_CATEG_NAME: string (nullable = true) |-- SITE_ID: integer (nullable = true) |-- CATEG_BUSN_MGR: string (nullable = true) |-- CATEG_BUSN_UNIT: string (nullable = true) |-- REGN_CATEG: string (nullable = true) |-- USER_DEFINED_FIELD1: string (nullable = true) |-- USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- META_CATEG_ID: decimal(19,4) (nullable = true) |-- META_CATEG_NAME: string (nullable = true) |-- CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL2_NAME: string (nullable = true) |-- CATEG_LVL3_NAME: string (nullable = true) |-- CATEG_LVL4_NAME: string (nullable = true) |-- CATEG_LVL5_NAME: string (nullable = true) |-- CATEG_LVL6_NAME: string (nullable = true) |-- CATEG_LVL7_NAME: string (nullable = true) |-- CATEG_FLAGS: decimal(19,4) (nullable = true) |-- ADULT_CATEG_YN: string (nullable = true) |-- DOMAIN_ID: decimal(19,4) (nullable = true) |-- USER_DEFINED_FIELD5: string (nullable = true) |-- VCS_ID: decimal(19,4) (nullable = true) |-- GCS_ID: decimal(19,4) (nullable = true) |-- MOVE_TO: decimal(19,4) (nullable = true) |-- SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- SRC_ID: byte (nullable = true) |-- BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:39,821 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- LEAF_CATEG_ID: long (nullable = true) |-- LEAF_CATEG_NAME: string (nullable = true) |-- SITE_ID: integer (nullable = true) |-- CATEG_BUSN_MGR: string (nullable = true) |-- CATEG_BUSN_UNIT: string (nullable = true) |-- REGN_CATEG: string (nullable = true) |-- USER_DEFINED_FIELD1: string (nullable = true) |-- USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- META_CATEG_ID: decimal(19,4) (nullable = true) |-- META_CATEG_NAME: string (nullable = true) |-- CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- CATEG_LVL2_NAME: string (nullable = true) |-- CATEG_LVL3_NAME: string (nullable = true) |-- CATEG_LVL4_NAME: string (nullable = true) |-- CATEG_LVL5_NAME: string (nullable = true) |-- CATEG_LVL6_NAME: string (nullable = true) |-- CATEG_LVL7_NAME: string (nullable = true) |-- CATEG_FLAGS: decimal(19,4) (nullable = true) |-- ADULT_CATEG_YN: string (nullable = true) |-- DOMAIN_ID: decimal(19,4) (nullable = true) |-- USER_DEFINED_FIELD5: string (nullable = true) |-- VCS_ID: decimal(19,4) (nullable = true) |-- GCS_ID: decimal(19,4) (nullable = true) |-- MOVE_TO: decimal(19,4) (nullable = true) |-- SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- SRC_ID: byte (nullable = true) |-- BSNS_VRTCL_NAME: string (nullable = true) to root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:39,821 INFO [pool-1-thread-1] builder.CreateFlatTable : Table KYLIN_CATEGORY_GROUPINGS schema root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:39,826 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,826 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,828 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,828 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,839 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,839 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,851 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select ACCOUNT_ID,ACCOUNT_BUYER_LEVEL,ACCOUNT_SELLER_LEVEL,ACCOUNT_COUNTRY,ACCOUNT_CONTACT from DEFAULT.KYLIN_ACCOUNT 2021-11-12 04:54:39,851 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,853 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) to root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,853 INFO [pool-1-thread-1] builder.CreateFlatTable : Table BUYER_ACCOUNT schema root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,855 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,855 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,858 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,858 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,868 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,868 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_account 2021-11-12 04:54:39,880 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select ACCOUNT_ID,ACCOUNT_BUYER_LEVEL,ACCOUNT_SELLER_LEVEL,ACCOUNT_COUNTRY,ACCOUNT_CONTACT from DEFAULT.KYLIN_ACCOUNT 2021-11-12 04:54:39,880 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,882 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- ACCOUNT_ID: long (nullable = true) |-- ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- ACCOUNT_COUNTRY: string (nullable = true) |-- ACCOUNT_CONTACT: string (nullable = true) to root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,882 INFO [pool-1-thread-1] builder.CreateFlatTable : Table SELLER_ACCOUNT schema root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,884 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,885 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,887 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,887 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,897 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,897 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,908 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select COUNTRY,LATITUDE,LONGITUDE,NAME from DEFAULT.KYLIN_COUNTRY 2021-11-12 04:54:39,908 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) 2021-11-12 04:54:39,911 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) to root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:39,911 INFO [pool-1-thread-1] builder.CreateFlatTable : Table BUYER_COUNTRY schema root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:39,912 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_database: default 2021-11-12 04:54:39,913 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_database: default 2021-11-12 04:54:39,915 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,915 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,924 INFO [pool-1-thread-1] metastore.HiveMetaStore : 0: get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,924 INFO [pool-1-thread-1] HiveMetaStore.audit : ugi=root ip=unknown-ip-addr cmd=get_table : db=default tbl=kylin_country 2021-11-12 04:54:39,935 INFO [pool-1-thread-1] source.HiveSource : Source data sql is: select COUNTRY,LATITUDE,LONGITUDE,NAME from DEFAULT.KYLIN_COUNTRY 2021-11-12 04:54:39,935 INFO [pool-1-thread-1] source.HiveSource : Kylin schema root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) 2021-11-12 04:54:39,937 INFO [pool-1-thread-1] builder.CreateFlatTable : After change alias from root |-- COUNTRY: string (nullable = true) |-- LATITUDE: double (nullable = true) |-- LONGITUDE: double (nullable = true) |-- NAME: string (nullable = true) to root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:39,937 INFO [pool-1-thread-1] builder.CreateFlatTable : Table SELLER_COUNTRY schema root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:39,938 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT: date (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_DT_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_RTL_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_AGE_FOR_CS_WEEK_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_YEAR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_QTR_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_MONTH_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_OF_CAL_ID: integer (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_QTR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_OF_CAL_ID: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_SHORT_NAME: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WTD_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_YEAR_COUNT: short (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_QTR_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_MONTH_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_IN_WEEK_COUNT: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_YEAR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CS_WEEK_BEG_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_DAY_OF_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_MONTH_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_FLAG: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_PRD_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_QTR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WEEK: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_YEAR: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_START_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RETAIL_WK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_NUM_DESC: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_END_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_IN_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MDY: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_END_DESC_MD: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YEAR_IND: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2YEAR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2QTR_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2MONTH_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_1WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CAL_DT_MNS_2WEEK_DT: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2YEAR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2QTR_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2MONTH_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_1WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_CURR_CAL_DT_MNS_2WEEK_YN_IND: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_MONTH_OF_RTL_YEAR_ID: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_QTR_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_RTL_WEEK_OF_RTL_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_SEASON_OF_YEAR_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTM_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTQ_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_YTW_YN_ID: byte (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_CRE_USER: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_DATE: string (nullable = true) |-- KYLIN_CAL_DT_0_DOT_0_KYLIN_CAL_DT_UPD_USER: string (nullable = true) 2021-11-12 04:54:39,939 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table KYLIN_CAL_DT, condition: (KYLIN_SALES_0_DOT_0_PART_DT = KYLIN_CAL_DT_0_DOT_0_CAL_DT) 2021-11-12 04:54:39,949 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID: long (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID: integer (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_MGR: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_BUSN_UNIT: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_REGN_CATEG: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_DATE: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_CRE_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_KYLIN_GROUPINGS_UPD_USER: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL4_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL5_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL6_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL7_NAME: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_FLAGS: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_ADULT_CATEG_YN: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_DOMAIN_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD5: string (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_VCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_GCS_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_MOVE_TO: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SAP_CATEGORY_ID: decimal(19,4) (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SRC_ID: byte (nullable = true) |-- KYLIN_CATEGORY_GROUPINGS_0_DOT_0_BSNS_VRTCL_NAME: string (nullable = true) 2021-11-12 04:54:39,949 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table KYLIN_CATEGORY_GROUPINGS, condition: ((KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID) AND (KYLIN_SALES_0_DOT_0_LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID)) 2021-11-12 04:54:39,963 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- BUYER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,963 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table BUYER_ACCOUNT, condition: (KYLIN_SALES_0_DOT_0_BUYER_ID = BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID) 2021-11-12 04:54:39,977 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID: long (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL: integer (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY: string (nullable = true) |-- SELLER_ACCOUNT_0_DOT_0_ACCOUNT_CONTACT: string (nullable = true) 2021-11-12 04:54:39,977 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table SELLER_ACCOUNT, condition: (KYLIN_SALES_0_DOT_0_SELLER_ID = SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID) 2021-11-12 04:54:39,991 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- BUYER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- BUYER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:39,991 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table BUYER_COUNTRY, condition: (BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY = BUYER_COUNTRY_0_DOT_0_COUNTRY) 2021-11-12 04:54:40,006 INFO [pool-1-thread-1] builder.CreateFlatTable : Lookup table schema root |-- SELLER_COUNTRY_0_DOT_0_COUNTRY: string (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LATITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_LONGITUDE: double (nullable = true) |-- SELLER_COUNTRY_0_DOT_0_NAME: string (nullable = true) 2021-11-12 04:54:40,006 INFO [pool-1-thread-1] builder.CreateFlatTable : Root table DEFAULT.KYLIN_SALES, join table SELLER_COUNTRY, condition: (SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY = SELLER_COUNTRY_0_DOT_0_COUNTRY) 2021-11-12 04:54:40,023 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model column is KYLIN_SALES_0_DOT_0_BUYER_ID AS `17`,KYLIN_SALES_0_DOT_0_SELLER_ID AS `16`,KYLIN_SALES_0_DOT_0_TRANS_ID AS `15`,KYLIN_SALES_0_DOT_0_PART_DT AS `14`,KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID AS `13`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME AS `12`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME AS `11`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME AS `10`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL AS `9`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL AS `8`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `7`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `6`,BUYER_COUNTRY_0_DOT_0_NAME AS `5`,SELLER_COUNTRY_0_DOT_0_NAME AS `4`,KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME AS `3`,KYLIN_SALES_0_DOT_0_LSTG_SITE_ID AS `2`,KYLIN_SALES_0_DOT_0_OPS_USER_ID AS `1`,KYLIN_SALES_0_DOT_0_OPS_REGION AS `0`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `27`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1 AS `22`,KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT AS `18`,BUYER_COUNTRY_0_DOT_0_COUNTRY AS `28`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `26`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID AS `24`,KYLIN_CAL_DT_0_DOT_0_CAL_DT AS `19`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3 AS `25`,KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT AS `20`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID AS `23`,KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT AS `21`,SELLER_COUNTRY_0_DOT_0_COUNTRY AS `29` 2021-11-12 04:54:40,023 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model encoding column is 2021-11-12 04:54:40,023 INFO [pool-1-thread-1] builder.CreateFlatTable : Select model all column is KYLIN_SALES_0_DOT_0_BUYER_ID AS `17`,KYLIN_SALES_0_DOT_0_SELLER_ID AS `16`,KYLIN_SALES_0_DOT_0_TRANS_ID AS `15`,KYLIN_SALES_0_DOT_0_PART_DT AS `14`,KYLIN_SALES_0_DOT_0_LEAF_CATEG_ID AS `13`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_META_CATEG_NAME AS `12`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL2_NAME AS `11`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_CATEG_LVL3_NAME AS `10`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_BUYER_LEVEL AS `9`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_SELLER_LEVEL AS `8`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `7`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_COUNTRY AS `6`,BUYER_COUNTRY_0_DOT_0_NAME AS `5`,SELLER_COUNTRY_0_DOT_0_NAME AS `4`,KYLIN_SALES_0_DOT_0_LSTG_FORMAT_NAME AS `3`,KYLIN_SALES_0_DOT_0_LSTG_SITE_ID AS `2`,KYLIN_SALES_0_DOT_0_OPS_USER_ID AS `1`,KYLIN_SALES_0_DOT_0_OPS_REGION AS `0`,SELLER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `27`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD1 AS `22`,KYLIN_CAL_DT_0_DOT_0_YEAR_BEG_DT AS `18`,BUYER_COUNTRY_0_DOT_0_COUNTRY AS `28`,BUYER_ACCOUNT_0_DOT_0_ACCOUNT_ID AS `26`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_SITE_ID AS `24`,KYLIN_CAL_DT_0_DOT_0_CAL_DT AS `19`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_USER_DEFINED_FIELD3 AS `25`,KYLIN_CAL_DT_0_DOT_0_MONTH_BEG_DT AS `20`,KYLIN_CATEGORY_GROUPINGS_0_DOT_0_LEAF_CATEG_ID AS `23`,KYLIN_CAL_DT_0_DOT_0_WEEK_BEG_DT AS `21`,SELLER_COUNTRY_0_DOT_0_COUNTRY AS `29` 2021-11-12 04:54:40,027 INFO [pool-1-thread-1] job.ParentSourceChooser : No suitable ready layouts could be reused, generate dataset from flat table. 2021-11-12 04:54:40,027 INFO [pool-1-thread-1] job.ParentSourceChooser : Sampling start ... 2021-11-12 04:54:40,321 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:40,323 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:40,327 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:40,331 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:40,334 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:40,339 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:40,677 INFO [pool-1-thread-1] mapred.FileInputFormat : Total input paths to process : 1 2021-11-12 04:54:42,641 INFO [pool-1-thread-1] job.ParentSourceChooser : Sampling finished and cost 2 s . 2021-11-12 04:54:42,647 INFO [pool-1-thread-1] job.ParentSourceChooser : Cuboid Statistics results : 16384:31, 16387:93, 16396:183, 16399:309, 16464:192, 16467:334, 16476:397, 16479:434, 16544:188, 16547:325, 16556:388, 16559:433, 16624:345, 16627:416, 16636:435, 16639:449, 17152:319, 17155:402, 17164:434, 17167:451, 17232:434, 17235:446, 17244:460, 17247:460, 17312:431, 17315:450, 17324:457, 17327:458, 17392:451, 17395:452, 17404:457, 17407:458, 20480:285, 20483:379, 20492:412, 20495:442, 20560:424, 20563:446, 20572:452, 20575:454, 20640:425, 20643:447, 20652:449, 20655:455, 20720:449, 20723:458, 20732:454, 20735:455, 21248:442, 21251:454, 21260:459, 21263:459, 21328:452, 21331:457, 21340:459, 21343:461, 21408:454, 21411:457, 21420:462, 21423:460, 21488:456, 21491:456, 21500:456, 21503:458, 22528:395, 22531:440, 22540:448, 22543:454, 22608:443, 22611:460, 22620:458, 22623:457, 22688:452, 22691:458, 22700:454, 22703:456, 22768:459, 22771:459, 22780:458, 22783:462, 23296:451, 23299:457, 23308:460, 23311:460, 23376:458, 23379:459, 23388:461, 23391:455, 23456:458, 23459:457, 23468:457, 23471:459, 23536:458, 23539:457, 23548:458, 23551:461, 23552:422, 23555:447, 23564:453, 23567:456, 23632:453, 23635:455, 23644:459, 23647:459, 23712:454, 23715:453, 23724:453, 23727:455, 23792:453, 23795:455, 23804:456, 23807:460, 24320:454, 24323:458, 24332:458, 24335:457, 24400:461, 24403:460, 24412:459, 24415:459, 24480:459, 24483:461, 24492:459, 24495:459, 24560:458, 24563:463, 24572:453, 24575:458, 31744:425, 31747:446, 31756:451, 31759:455, 31824:455, 31827:456, 31836:460, 31839:462, 31904:451, 31907:457, 31916:456, 31919:455, 31984:457, 31987:459, 31996:455, 31999:457, 32512:460, 32515:457, 32524:460, 32527:461, 32592:461, 32595:460, 32604:459, 32607:460, 32672:456, 32675:455, 32684:456, 32687:456, 32752:459, 32755:459, 32764:460, 32767:458 2021-11-12 04:54:42,647 INFO [pool-1-thread-1] job.CubeBuildJob : Cuboid statistics return 160 records and cost 2992 ms. 2021-11-12 04:54:42,775 INFO [pool-1-thread-1] job.CubeBuildJob : kylin_sales_cube_TestRepartition[20120101000000_20120201000000]'s stats saved to resource key(/cube_statistics/kylin_sales_cube_TestRepartition/5a515f3a-3415-5445-2cf2-676e1f8063f8.seq) with path(hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be/cube_statistics/a7c6eead-a7b5-d3ef-44d6-3e772d90b225/5a515f3a-3415-5445-2cf2-676e1f8063f8/cuboid_statistics.seq) 2021-11-12 04:54:42,775 INFO [pool-1-thread-1] common.StatisticsDecisionUtil : It's able to trigger cuboid planner algorithm. 2021-11-12 04:54:42,783 INFO [pool-1-thread-1] common.CubeStatsReader : Reading statistics from file:/tmp/kylin_stats_tmp274832472259525701.seq 2021-11-12 04:54:42,837 INFO [pool-1-thread-1] common.KylinConfig : Creating new manager instance of class org.apache.kylin.cube.cuboid.CuboidManager 2021-11-12 04:54:42,837 ERROR [pool-1-thread-1] application.SparkApplication : The spark job execute failed! java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:238) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:187) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:183) at org.apache.kylin.engine.mr.common.CuboidRecommenderUtil.getRecommendCuboidList(CuboidRecommenderUtil.java:64) at org.apache.kylin.engine.mr.common.StatisticsDecisionUtil.optimizeCubingPlan(StatisticsDecisionUtil.java:104) at org.apache.kylin.engine.spark.job.CubeBuildJob.doExecute(CubeBuildJob.java:154) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:304) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:93) at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-11-12 04:54:42,837 ERROR [pool-1-thread-1] application.JobMonitor : Job failed the 3 times. java.lang.RuntimeException: Error execute org.apache.kylin.engine.spark.job.CubeBuildJob at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:96) at org.apache.spark.application.JobWorker$$anon$2.run(JobWorker.scala:55) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:238) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:187) at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:183) at org.apache.kylin.engine.mr.common.CuboidRecommenderUtil.getRecommendCuboidList(CuboidRecommenderUtil.java:64) at org.apache.kylin.engine.mr.common.StatisticsDecisionUtil.optimizeCubingPlan(StatisticsDecisionUtil.java:104) at org.apache.kylin.engine.spark.job.CubeBuildJob.doExecute(CubeBuildJob.java:154) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:304) at org.apache.kylin.engine.spark.application.SparkApplication.execute(SparkApplication.java:93) ... 4 more 2021-11-12 04:54:42,853 INFO [pool-1-thread-1] application.SparkApplication : Executor task org.apache.kylin.engine.spark.job.CubeBuildJob with args : {"distMetaUrl":"kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta","submitter":"ADMIN","dataRangeEnd":"1328054400000","targetModel":"0928468a-9fab-4185-9a14-6f2e7c74823f","dataRangeStart":"1325376000000","project":"learn_kylin","className":"org.apache.kylin.engine.spark.job.CubeBuildJob","segmentName":"20120101000000_20120201000000","parentId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","jobId":"866451fe-23f0-4c04-9c9f-53a8ed4aa1be","outputMetaUrl":"kylin_metadata@jdbc,url=jdbc:mysql://localhost:3306/kylin?useSSL=false,username=root,password=******,maxActive=10,maxIdle=10","segmentId":"5a515f3a-3415-5445-2cf2-676e1f8063f8","cuboidsNum":"161","cubeName":"kylin_sales_cube_TestRepartition","jobType":"BUILD","cubeId":"a7c6eead-a7b5-d3ef-44d6-3e772d90b225","segmentIds":"5a515f3a-3415-5445-2cf2-676e1f8063f8"} 2021-11-12 04:54:42,853 INFO [pool-1-thread-1] utils.MetaDumpUtil : Ready to load KylinConfig from uri: kylin_metadata@hdfs,path=hdfs://master/kylin/kylin_metadata/learn_kylin/job_tmp/866451fe-23f0-4c04-9c9f-53a8ed4aa1be-01/meta 2021-11-12 04:54:42,868 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.metadata.url.identifier : kylin_metadata 2021-11-12 04:54:42,868 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.log.spark-executor-properties-file : /opt/kylin/conf/spark-executor-log4j.properties 2021-11-12 04:54:42,868 INFO [pool-1-thread-1] common.KylinConfigBase : Kylin Config was updated with kylin.source.provider.0 : org.apache.kylin.engine.spark.source.HiveSource 2021-11-12 04:54:42,868 INFO [pool-1-thread-1] util.TimeZoneUtils : System timezone set to America/New_York, TimeZoneId: America/New_York. 2021-11-12 04:54:42,868 INFO [pool-1-thread-1] application.SparkApplication : Sleep for random seconds to avoid submitting too many spark job at the same time. 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stdout {"scheduler":{"schedulerInfo":{"type":"capacityScheduler","capacity":100.0,"usedCapacity":48.107384,"maxCapacity":100.0,"queueName":"root","queues":{"queue":[{"type":"capacitySchedulerLeafQueueInfo","capacity":100.0,"usedCapacity":48.107384,"maxCapacity":100.0,"absoluteCapacity":100.0,"absoluteMaxCapacity":100.0,"absoluteUsedCapacity":48.107384,"numApplications":1,"queueName":"default","state":"RUNNING","resourcesUsed":{"memory":21504,"vCores":11},"hideReservationQueues":false,"nodeLabels":["*"],"numActiveApplications":1,"numPendingApplications":0,"numContainers":11,"maxApplications":10000,"maxApplicationsPerUser":10000,"userLimit":100,"users":{"user":[{"username":"root","resourcesUsed":{"memory":21504,"vCores":11},"numPendingApplications":0,"numActiveApplications":1,"AMResourceUsed":{"memory":1024,"vCores":1},"userResourceLimit":{"memory":45056,"vCores":1}}]},"userLimitFactor":1.0,"AMResourceLimit":{"memory":5120,"vCores":1},"usedAMResource":{"memory":1024,"vCores":1},"userAMResourceLimit":{"memory":5120,"vCores":1},"preemptionDisabled":true}]}}}} 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr % Total % Received % Xferd Average Speed Time Time Time Current 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr Dload Upload Total Spent Left Speed 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : stderr 100 1064 0 1064 0 0 395k 0 --:--:-- --:--:-- --:--:-- 519k 2021-11-12 04:55:19,359 INFO [pool-1-thread-1] cluster.SchedulerInfoCmdHelper : Thread wait for executing command curl -k --negotiate -u : "http://0.0.0.0:8088/ws/v1/cluster/scheduler" 2021-11-12 04:55:19,365 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Queue available capacity: 0.5189261599999999. 2021-11-12 04:55:19,365 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Estimate total cluster resource is ResourceInfo(44699,2147483647). 2021-11-12 04:55:19,365 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Cluster available capacity: 0.5189261599999999. 2021-11-12 04:55:19,365 INFO [pool-1-thread-1] parser.CapacitySchedulerParser : Capacity actual available resource: AvailableResource(ResourceInfo(23195,1114385442),ResourceInfo(44699,2147483647)). 2021-11-12 04:55:19,365 INFO [pool-1-thread-1] application.SparkApplication : Current available resource in cluster is not sufficient, wait for a period: 180536.