[KYLIN-3772] CubeMetaIngester works abnormally

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v2.3.0, v2.4.0, v2.5.0, v2.6.0
• Fix Version/s: v2.6.1
• Component/s: Tools, Build and Test
• Assignee: Temple Zhou
• Reporter: Temple Zhou
• Created: 16/Jan/19 06:57
• Updated: 08/Mar/19 01:19
• Resolved: 22/Feb/19 10:34

Description

I have used the following cmd to extract the cube named xxx_cube, and the result looks good. However...

org.apache.kylin.tool.CubeMetaExtractor -cube xxx_cube -destDir /Users/zhoutianpeng/tmp

========================================
Dump base package locates at: 
/Users/zhoutianpeng/tmp/base_2019_01_17_11_35_33/base_2019_01_17_11_35_33.zip
========================================

When I was trying to ingest the dump file, I got the following exception:

Exception in thread "main" java.lang.RuntimeException: error execute org.apache.kylin.tool.CubeMetaIngester. Root cause: null
	at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
	at org.apache.kylin.tool.CubeMetaIngester.main(CubeMetaIngester.java:217)
Caused by: java.lang.NullPointerException
	at org.apache.kylin.tool.CubeMetaIngester.injest(CubeMetaIngester.java:151)
	at org.apache.kylin.tool.CubeMetaIngester.execute(CubeMetaIngester.java:126)
	at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
	... 1 more

I found that the model is null in org.apache.kylin.cube.model.CubeDesc#getModel

Then, I found that the reason is that org.apache.kylin.metadata.cachesync.CachedCrudAssist#initEntityAfterReload throws the java.lang.IllegalStateException: No project found for model xxx_model, which contributes to the failure of model init, so the model is null.

Maybe, the root cause is that the extracted files don't contain the /project/xxx.json, so "No project found for model xxx_model" and the model is null because of the failed init.

Issue Links

• links to: GitHub Pull Request #431