[TAJO-1097] IllegalArgumentException: RawFileScanner

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Component/s: Data Shuffle, Storage
• Assignee: Mai Hai Thanh
• Reporter: Jinho Kim
• Created: 06/Oct/14 15:08
• Updated: 15/Oct/14 09:35
• Resolved: 08/Oct/14 08:01

Description

When I ran my customer query and TPCH-Q9, got this error.

Q9

select 
  nation, o_year, sum(amount) as sum_profit
from 
  (
select 
  n_name as nation, substr(o_orderdate, 1, 4) as o_year, 
  l_extendedprice * (1 - l_discount) -  ps_supplycost * l_quantity as amount
    from
      orders o join
      (select l_extendedprice, l_discount, l_quantity, l_orderkey, n_name, ps_supplycost 
       from part p join
         (select l_extendedprice, l_discount, l_quantity, l_partkey, l_orderkey, 
                 n_name, ps_supplycost 
          from partsupp ps join
            (select l_suppkey, l_extendedprice, l_discount, l_quantity, l_partkey, 
                    l_orderkey, n_name 
             from
               (select s_suppkey, n_name 
                from nation n join supplier s on n.n_nationkey = s.s_nationkey
               ) s1 join lineitem l on s1.s_suppkey = l.l_suppkey
            ) l1 on ps.ps_suppkey = l1.l_suppkey and ps.ps_partkey = l1.l_partkey
         ) l2 on p.p_name like '%green%' and p.p_partkey = l2.l_partkey
     ) l3 on o.o_orderkey = l3.l_orderkey
  )profit
group by nation, o_year
order by nation, o_year desc;

ERROR: java.lang.IllegalArgumentException
java.io.IOException: java.lang.IllegalArgumentException
	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:152)
	at org.apache.tajo.worker.Task.run(Task.java:446)
	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:276)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
	at java.nio.Buffer.limit(Buffer.java:267)
	at org.apache.tajo.storage.RawFile$RawFileScanner.fillBuffer(RawFile.java:154)
	at org.apache.tajo.storage.RawFile$RawFileScanner.next(RawFile.java:263)
	at org.apache.tajo.storage.MergeScanner.next(MergeScanner.java:95)
	at org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:268)
	at org.apache.tajo.engine.planner.physical.HashJoinExec.next(HashJoinExec.java:117)
	at org.apache.tajo.engine.planner.physical.ProjectionExec.next(ProjectionExec.java:54)
	at org.apache.tajo.engine.planner.physical.ProjectionExec.next(ProjectionExec.java:54)
	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:107)
	... 3 more