Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3551

Spark job failed with "FileNotFoundException"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • v2.5.0
    • Spark Engine
    • None

    Description

      java.io.FileNotFoundException: File does not exist: hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default_instance/kylin-a3e39298-8dc3-21f2-cf16-0aa5e451c777/kylin_sales_cube_clone_clone/counter
      at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1319)
      at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1311)
      at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1311)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1752)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1776)
      at org.apache.kylin.common.util.HadoopUtil.readFromSequenceFile(HadoopUtil.java:218)
      at org.apache.kylin.common.util.HadoopUtil.readFromSequenceFile(HadoopUtil.java:233)
      at org.apache.kylin.engine.spark.SparkExecutable.doWork(SparkExecutable.java:319)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
      at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
      at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)

      Attachments

        Issue Links

          Activity

            People

              Wayne0101 Chao Long
              shaofengshi Shao Feng Shi
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: