Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-5065

error when TrieDictionaryForestBuilder.build

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • v3.1.2
    • None
    • None

    Description

      when i build my cube,an error appeared, but the same cube built succeed in test environment.

      i dont konw why. 

      who can help me. thank you very much.

       my  kylin version  is 3.1.2 , the latest version .

      Job Error Details

      Error Step Extract Fact Table Distinct Columns
      MR Job job_1628056838389_5692

       

      error information:

      org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error: java.lang.IllegalStateException: Invalid input data. Unordered data can not be split into multi trees        at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)        at org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)        at org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)        at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)        at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)        at org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163)        at java.security.AccessController.doPrivileged(Native Method)        at javax.security.auth.Subject.doAs(Subject.java:422)        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)          at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)        at org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238)        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)        at java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)        at java.lang.Thread.run(Thread.java:748)Caused by: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error: java.lang.IllegalStateException: Invalid input data. Unordered data can not be split into multi trees        at org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)        at org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)        at org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)        at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179)        at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)        at org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163)        at java.security.AccessController.doPrivileged(Native Method)        at javax.security.auth.Subject.doAs(Subject.java:422)        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)          at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:235)        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)        ... 6 more

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            andy1986 andy peng

            Dates

              Created:
              Updated:

              Slack

                Issue deployment