Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3219

Fix NPE when updating metrics during Spark CubingJob

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: v2.3.0
    • Fix Version/s: v2.3.0
    • Component/s: Job Engine
    • Labels:
      None

      Description

      When using spark engine, there is no 'Build Cube In-Mem' step task,
      'getTaskByName(ExecutableConstants.STEP_NAME_BUILD_IN_MEM_CUBE).getDuration()' will get NullPointerException

      error log:

      java.lang.NullPointerException
      at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
      at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
      at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
      at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
      at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
      at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
      at java.lang.Thread.run(Thread.java:745)
      2018-01-31 18:15:20,443 ERROR [pool-11-thread-10] threadpool.DefaultScheduler:302 : ExecuteException job:693e2cd6-c7e7-4ed9-b1d6-e7ad86f5c501
      org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
      at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.NullPointerException
      at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
      at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
      at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
      at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
      at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
      ... 4 more

        Attachments

        1. 0001-KYLIN-3219.patch
          2 kB
          Peng Xing

          Issue Links

            Activity

              People

              • Assignee:
                xingpeng1 Peng Xing
                Reporter:
                xingpeng1 Peng Xing
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: