[ASTERIXDB-1791] HyracksDataException: Premature file in Join operator

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Assignee: Yingyi Bu
• Reporter: Yingyi Bu
• Created: 13/Feb/17 16:19
• Updated: 24/Feb/17 06:18
• Resolved: 24/Feb/17 06:18

Description

Configuration:
2 NC
1 GB RAM each
TPC-H dataset with SF=2

Query (TPC-H Q18):

USE tpch;

SET `compiler.joinmemory` "8MB"
SET `compiler.groupmemory` "8MB"
SET `compiler.sortmemory` "8MB"

WITH tmp AS
(
    SELECT l_orderkey, SUM(l_quantity) t_sum_quantity
    FROM  LineItem
    GROUP BY l_orderkey
)

SELECT c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice,
       SUM(l.l_quantity) sum_quantity
FROM  LineItem l
JOIN  tmp t ON t.l_orderkey = l.l_orderkey
JOIN  Orders o ON o.o_orderkey = t.l_orderkey
JOIN  Customer c ON c.c_custkey = o.o_custkey
WHERE t.t_sum_quantity > 30
GROUP BY c.c_name, c.c_custkey, o.o_orderkey, o.o_orderdate, o.o_totalprice
ORDER BY o.o_totalprice DESC, o.o_orderdate
LIMIT 100
;

Error:

Premature end of file

        at org.apache.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:223)
        at org.apache.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:50)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Premature end of file
        at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:41)
        at org.apache.hyracks.control.common.utils.ExceptionUtils.setNodeIds(ExceptionUtils.java:62)
        at org.apache.hyracks.control.nc.Task.run(Task.java:330)
        ... 3 more
Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Premature end of file
        at org.apache.hyracks.dataflow.common.io.RunFileReader.nextFrame(RunFileReader.java:66)
        at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.applyInMemHashJoin(OptimizedHybridHashJoinOperatorDescriptor.java:672)
        at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.joinPartitionPair(OptimizedHybridHashJoinOperatorDescriptor.java:503)
        at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:435)
        at org.apache.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:439)
        at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:367)
        at org.apache.hyracks.control.nc.Task.run(Task.java:308)
        ... 3 more
Feb 13, 2017 4:05:33 PM org.apache.asterix.api.http.server.QueryServiceServlet handleRequest
SEVERE: Job failed on account of:
Premature end of file

org.apache.hyracks.api.exceptions.HyracksException: Job failed on account of:
Premature end of file