[KYLIN-2461] An error when Cube runs the action "build" :java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getUGIForConf(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation

• Type: Test
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: v1.5.1
• Fix Version/s: 1.x-HBase1.1.3
• Labels: build security
• Environment: Hadoop 2.6.0-cdh5.6.0; Hive 2.0.0; HBase 1.1.8; apache-kylin-1.5.1-bin
• Assignee: Unassigned
• Reporter: chunyanglu
• Created: 23/Feb/17 07:05
• Updated: 02/Mar/17 00:13
• Resolved: 02/Mar/17 00:13

Description

I an login in the web https://bihdp06:7070/kylin with ADMIN/KYLIN

After i select action Build

step 1 "Create Intermediate Flat Hive Table" is working well

but when it comes step 2: Extract Fact Table Distinct Columns ,it throws an ERROR:
java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getUGIForConf(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/security/UserGroupInformation;
at org.apache.hive.hcatalog.common.HiveClientCache$HiveClientCacheKey.(HiveClientCache.java:250)
at org.apache.hive.hcatalog.common.HiveClientCache$HiveClientCacheKey.fromHiveConf(HiveClientCache.java:256)
at org.apache.hive.hcatalog.common.HiveClientCache.get(HiveClientCache.java:187)
at org.apache.hive.hcatalog.common.HCatUtil.getHiveClient(HCatUtil.java:569)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:104)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:81)
at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:111)
at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:91)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)