Uploaded image for project: 'Apache AsterixDB'
  1. Apache AsterixDB
  2. ASTERIXDB-1791

HyracksDataException: Premature file in Join operator

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Configuration:
      2 NC
      1 GB RAM each
      TPC-H dataset with SF=2

      Query (TPC-H Q18):

      USE tpch;
      
      SET `compiler.joinmemory` "8MB"
      SET `compiler.groupmemory` "8MB"
      SET `compiler.sortmemory` "8MB"
      
      WITH tmp AS
      (
          SELECT l_orderkey, SUM(l_quantity) t_sum_quantity
          FROM  LineItem
          GROUP BY l_orderkey
      )
      
      SELECT c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice,
             SUM(l.l_quantity) sum_quantity
      FROM  LineItem l
      JOIN  tmp t ON t.l_orderkey = l.l_orderkey
      JOIN  Orders o ON o.o_orderkey = t.l_orderkey
      JOIN  Customer c ON c.c_custkey = o.o_custkey
      WHERE t.t_sum_quantity > 30
      GROUP BY c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice
      ORDER BY o.o_totalprice DESC, o.o_orderdate
      LIMIT 100
      ;
      

      Error:

      Premature end of file
      
              at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:223)
              at org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:50)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Premature end of file
              at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:41)
              at org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62)
              at org.apache.hyracks.control.nc.Task.run(Task.java:330)
              ... 3 more
      Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Premature end of file
              at org.apache.hyracks.dataflow.common.io.RunFileReader.nextFrame(RunFileReader.java:66)
              at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.applyInMemHashJoin(OptimizedHybridHashJoinOperatorDescriptor.java:672)
              at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.joinPartitionPair(OptimizedHybridHashJoinOperatorDescriptor.java:503)
              at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:435)
              at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:439)
              at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:367)
              at org.apache.hyracks.control.nc.Task.run(Task.java:308)
              ... 3 more
      Feb 13, 2017 4:05:33 PM org.apache.asterix.api.http.server.QueryServiceServlet handleRequest
      SEVERE: Job failed on account of:
      Premature end of file
      
      org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of:
      Premature end of file
      
      

        Attachments

          Activity

            People

            • Assignee:
              buyingyi Yingyi Bu
              Reporter:
              buyingyi Yingyi Bu
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: