[KYLIN-5018] Failed to create HTable

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: v3.1.2
• Component/s: Storage - HBase
• Environment: Hadoop 3.2.2 ; Hive 3.1.2 ; HBase 2.4.2
• Assignee: Unassigned
• Reporter: Lim Sing Yik
• Created: 28/Jun/21 09:01
• Updated: 28/Jun/21 09:43

Description

Appreciate someone can help

Run sample cube from learn_kylin Project. Encounter error at step 6 Create HTable.

 I manage to create Hbase table "test" using Hbase Shell, and the kylin manage to create upload the "kylin_metadata" into HBase. 

 

 

Env:

Hadoop 3.2.2

Hive 3.1.2

HBase 2.4.2

 

Error msg:

java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;

        at org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100)

        at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121)

        at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)

        at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64)

        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)

        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)

        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)

        at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

 

 

Detail Kylin Log:

17:25:53.206 [Scheduler 1819501582 Job be5d023c-00f7-2270-0af1-10c2c38ed6f3-81] ERROR org.apache.kylin.job.execution.AbstractExecutable - error running Executable: HadoopShellExecutable{id=be5d023c-00f7-2270-0af1-10c2c38ed6f3-05, name=Create HTable, state=RUNNING}
17:25:53.240 [Scheduler 1819501582 Job be5d023c-00f7-2270-0af1-10c2c38ed6f3-81] ERROR org.apache.kylin.job.execution.AbstractExecutable - error running Executable: CubingJob{id=be5d023c-00f7-2270-0af1-10c2c38ed6f3, name=BUILD CUBE - kylin_sales_cube_clone - 20100101000000_20101231235500 - MYT 2021-06-28 13:37:38, state=RUNNING}
17:25:53.288 [pool-12-thread-1] ERROR org.apache.kylin.job.impl.threadpool.DefaultScheduler - ExecuteException job:be5d023c-00f7-2270-0af1-10c2c38ed6f3
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201) ~[kylin-core-job-3.1.2.jar:3.1.2]
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:119) [kylin-core-job-3.1.2.jar:3.1.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_292]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_292]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_292]
Caused by: org.apache.kylin.job.exception.ExecuteException: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201) ~[kylin-core-job-3.1.2.jar:3.1.2]
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72) ~[kylin-core-job-3.1.2.jar:3.1.2]
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) ~[kylin-core-job-3.1.2.jar:3.1.2]
... 4 more
Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.TableDescriptorBuilder.setColumnFamily(Lorg/apache/hadoop/hbase/client/ColumnFamilyDescriptor;)Lorg/apache/hadoop/hbase/client/TableDescriptorBuilder;
at org.apache.kylin.storage.hbase.steps.CubeHTableUtil.createHTable(CubeHTableUtil.java:100) ~[kylin-storage-hbase-3.1.2.jar:3.1.2]
at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:121) ~[kylin-storage-hbase-3.1.2.jar:3.1.2]
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93) ~[kylin-engine-mr-3.1.2.jar:3.1.2]
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:64) ~[kylin-engine-mr-3.1.2.jar:3.1.2]
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) ~[kylin-core-job-3.1.2.jar:3.1.2]
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72) ~[kylin-core-job-3.1.2.jar:3.1.2]
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180) ~[kylin-core-job-3.1.2.jar:3.1.2]
... 4 more