Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1590

2 Kylin Steaming merge jobs of same time range triggered and failed

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Won't Fix
    • Affects Version/s: v1.4.0
    • Fix Version/s: None
    • Component/s: NRT Streaming
    • Labels:
      None

      Description

      2 issues:
      1. Kylin allows 2 merge jobs with same time range running.
      2. when 2 merge jobs with same time range are running on the same time, they mixed up metadata, always get the HTable not found error.
      Build Result of Job site_gmb - 20160415212000_20160415215000 - MERGE - PDT 2016-04-15 14:58:38
      Build Result: ERROR
      Job Engine: ***
      Cube Name: site_gmb
      Source Records Count: 0
      Start Time: Fri Apr 15 14:58:44 PDT 2016
      Duration: 2mins
      MR Waiting: 0mins
      Last Update Time: Fri Apr 15 15:01:42 PDT 2016
      Submitter: SYSTEM
      Error Log: org.apache.hadoop.hbase.TableNotFoundException: KYLIN_NB2J0SRADJ
      at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1299)
      at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1128)
      at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1111)
      at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1070)
      at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:347)
      at org.apache.hadoop.hbase.client.HTable.(HTable.java:201)
      at org.apache.hadoop.hbase.client.HTable.(HTable.java:159)
      at org.apache.kylin.storage.hbase.steps.CubeHFileJob.run(CubeHFileJob.java:87)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
      at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105)
      at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105)
      at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)

      result code:2

        Attachments

          Activity

            People

            • Assignee:
              yaho Zhong Yanghong
              Reporter:
              qianqiaoneng qianqiaoneng
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: