[KYLIN-1120] MapReduce job read local meta issue

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: v1.0, v1.1
• Fix Version/s: v1.2
• Component/s: Storage - HBase
• Environment: Kylin-1.x-staging branch
• Flags: Patch
• Assignee: liyang
• Reporter: Xiaoyu Wang
• Created: 03/Nov/15 10:05
• Updated: 22/Dec/15 09:24
• Resolved: 05/Nov/15 03:00

Description

set the property "kylin.metadata.url" in kylin.properties like this:

kylin.metadata.url=kylin_metadata_test1.2@hbase

1.Create a test cube and build.
2.In the step 2:"Fact_Distinct_Columns" got exception:

2015-11-02 17:23:50,354 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.NullPointerException
	at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsMapper.setup(FactDistinctColumnsMapper.java:73)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

reason:
In the MapReduce job Kylin set the local dir to metadataUrl for read metadata.

FactDistinctColumnsMapper.java

KylinConfig config = AbstractHadoopJob.loadKylinPropsAndMetadata(conf);

But the ResourceStore.java return a "HBaseResourceStore" instance from "getStore" method.
Because the HBaseResourceStore's constructor will not throw exception when the metadataUrl is local address not "xxx@hbase"
"HBaseResourceStore" will read the default HBase table "kylin_metadata" to get the cube metadata and My metadata is in "kylin_metadata_test1.2" table,so got the NPE.

I modify the class add order in ResourceStore's static code to fixed this issue.

Issue Links

• duplicates: KYLIN-1121 ResourceTool download/upload does not work in binary package