[KYLIN-3219] Fix NPE when updating metrics during Spark CubingJob

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: v2.3.0
• Fix Version/s: v2.3.0
• Component/s: Job Engine
• Assignee: Peng Xing
• Reporter: Peng Xing
• Created: 01/Feb/18 02:31
• Updated: 02/Apr/18 13:42
• Resolved: 05/Feb/18 14:21

Description

When using spark engine, there is no 'Build Cube In-Mem' step task,
'getTaskByName(ExecutableConstants.STEP_NAME_BUILD_IN_MEM_CUBE).getDuration()' will get NullPointerException

error log:

java.lang.NullPointerException
at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
at java.lang.Thread.run(Thread.java:745)
2018-01-31 18:15:20,443 ERROR [pool-11-thread-10] threadpool.DefaultScheduler:302 : ExecuteException job:693e2cd6-c7e7-4ed9-b1d6-e7ad86f5c501
org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
... 4 more

Issue Links

• duplicates: KYLIN-3316 Reported NPE after cube build