[KYLIN-1862] "table not found" in "Build Dimension Dictionary" step

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v1.5.3
• Fix Version/s: v1.5.3
• Component/s: Job Engine
• Assignee: Shao Feng Shi
• Reporter: Shao Feng Shi
• Created: 08/Jul/16 13:27
• Updated: 28/Jul/16 06:48
• Resolved: 11/Jul/16 02:53

Description

In a cube, I use a hive view as lookup table; The view name is "ssb.v_customer";

In the "Materialize Hive View in Lookup Tables" step, the log said:

Table default.kylin_intermediate_ssb_v_customer stats: [numFiles=2, numRows=1800000, totalSize=82661469, rawDataSize=169673761]

In the "Build Dimension Dictionary" step, it failed with message:

"DEFAULT.kylin_intermediate_DEFAULT_V_CUSTOMER table not found"

Error trace:

NoSuchObjectException(message:DEFAULT.kylin_intermediate_DEFAULT_V_CUSTOMER table not found)
	at org.apache.kylin.source.hive.HiveTable.getSignature(HiveTable.java:71)
	at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:302)
	at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:185)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:51)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
	at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:112)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:112)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:127)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

Issue Links

• duplicates: KYLIN-1882 it report can't find the intermediate table in '#4 Step Name: Build Dimension Dictionary' when use hive view as lookup table