Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-3551

Spark job failed with "FileNotFoundException"

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v2.5.0
    • Component/s: Spark Engine
    • Labels:
      None

      Description

      java.io.FileNotFoundException: File does not exist: hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default_instance/kylin-a3e39298-8dc3-21f2-cf16-0aa5e451c777/kylin_sales_cube_clone_clone/counter
      at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1319)
      at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1311)
      at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1311)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1752)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1776)
      at org.apache.kylin.common.util.HadoopUtil.readFromSequenceFile(HadoopUtil.java:218)
      at org.apache.kylin.common.util.HadoopUtil.readFromSequenceFile(HadoopUtil.java:233)
      at org.apache.kylin.engine.spark.SparkExecutable.doWork(SparkExecutable.java:319)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
      at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
      at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
      at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Wayne0101 Chao Long
                Reporter:
                shaofengshi Shao Feng Shi
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: