Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
v3.0.1
-
None
-
None
-
HDP-3.1.0.0
Apache kylin 3.0.1
Kafka 2.0.0
Description
Use the official sample action "Quick Start with Streaming Sample Cube" build Error，The error message is as follows:
--------------------------error logs--------------------------
2020-03-17 15:37:13,389 ERROR [Scheduler 775260112 Job 94b82185-70b0-2a4d-e83e-e5bbdecefa3f-430] execution.AbstractExecutable:181 : error running Executable: CubingJob{id=94b82185-70b0-2a4d-e83e-e5bbdecefa3f, name=BUILD CUBE - kylin_streaming_cube - 0_2128 - CST 2020-03-17 15:35:57, state=RUNNING}
2020-03-17 15:37:13,395 DEBUG [pool-7-thread-1] cachesync.Broadcaster:119 : Servers in the cluster: [localhost:7070]
2020-03-17 15:37:13,396 DEBUG [pool-7-thread-1] cachesync.Broadcaster:129 : Announcing new broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=94b82185-70b0-2a4d-e83e-e5bbdecefa3f}
2020-03-17 15:37:13,401 DEBUG [http-nio-7070-exec-4] cachesync.Broadcaster:267 : Broadcasting UPDATE, execute_output, 94b82185-70b0-2a4d-e83e-e5bbdecefa3f
2020-03-17 15:37:13,402 INFO [Scheduler 775260112 Job 94b82185-70b0-2a4d-e83e-e5bbdecefa3f-430] execution.ExecutableManager:478 : job id:94b82185-70b0-2a4d-e83e-e5bbdecefa3f from RUNNING to ERROR
2020-03-17 15:37:13,402 DEBUG [Scheduler 775260112 Job 94b82185-70b0-2a4d-e83e-e5bbdecefa3f-430] execution.AbstractExecutable:332 : no need to send email, user list is empty
2020-03-17 15:37:13,403 DEBUG [pool-7-thread-1] cachesync.Broadcaster:119 : Servers in the cluster: [localhost:7070]
2020-03-17 15:37:13,403 DEBUG [pool-7-thread-1] cachesync.Broadcaster:129 : Announcing new broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=94b82185-70b0-2a4d-e83e-e5bbdecefa3f}
2020-03-17 15:37:13,403 DEBUG [http-nio-7070-exec-4] cachesync.Broadcaster:301 : Done broadcasting UPDATE, execute_output, 94b82185-70b0-2a4d-e83e-e5bbdecefa3f
2020-03-17 15:37:13,404 ERROR [pool-11-thread-10] threadpool.DefaultScheduler:116 : ExecuteException job:94b82185-70b0-2a4d-e83e-e5bbdecefa3f
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 12
Job Counters
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=109572
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=27393
Total vcore-milliseconds taken by all map tasks=27393
Total megabyte-milliseconds taken by all map tasks=37364052
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Job Diagnostics:Task failed task_1584424619465_0006_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
Failure task Diagnostics:
Error: org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:194)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 12
Job Counters
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=109572
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=27393
Total vcore-milliseconds taken by all map tasks=27393
Total megabyte-milliseconds taken by all map tasks=37364052
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Job Diagnostics:Task failed task_1584424619465_0006_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
--------------------------error logs--------------------------
Help, thanks!
Attachments
Issue Links
- is duplicated by
-
-
- Resolved
-