[KYLIN-3752] NullPointerException in the first cubing step：org.apache.kylin.source.hive.CreateFlatHiveTableStep.getCubeSpecificConfig(CreateFlatHiveTableStep.java:92)

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: v2.5.0
• Fix Version/s: v2.6.0
• Component/s: Job Engine
• Assignee: xiaodongzhang
• Reporter: xiaodongzhang
• Created: 02/Jan/19 03:04
• Updated: 12/Jan/19 06:41
• Resolved: 03/Jan/19 07:13

Description

异常如下：
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178) at org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:111) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) ... 4 more Caused by: java.lang.NullPointerException at org.apache.kylin.source.hive.CreateFlatHiveTableStep.getCubeSpecificConfig(CreateFlatHiveTableStep.java:92) at org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork(CreateFlatHiveTableStep.java:97) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) ... 6 more
具体原因：默认配置只有一个线程来串行处理广播事件，当集群节点达到十个左右时，一个事件的同步平均耗时一分钟左右，因此会导致Table、Model、Cube的滞后同步影响分布式构建。

解决办法：https://github.com/apache/kylin/pull/427

Issue Links

• links to: GitHub Pull Request #427