Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1097

IllegalArgumentException: RawFileScanner

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.9.0
    • Component/s: Data Shuffle, Storage
    • Labels:
      None

      Description

      When I ran my customer query and TPCH-Q9, got this error.

      Q9
      select 
        nation, o_year, sum(amount) as sum_profit
      from 
        (
      select 
        n_name as nation, substr(o_orderdate, 1, 4) as o_year, 
        l_extendedprice * (1 - l_discount) -  ps_supplycost * l_quantity as amount
          from
            orders o join
            (select l_extendedprice, l_discount, l_quantity, l_orderkey, n_name, ps_supplycost 
             from part p join
               (select l_extendedprice, l_discount, l_quantity, l_partkey, l_orderkey, 
                       n_name, ps_supplycost 
                from partsupp ps join
                  (select l_suppkey, l_extendedprice, l_discount, l_quantity, l_partkey, 
                          l_orderkey, n_name 
                   from
                     (select s_suppkey, n_name 
                      from nation n join supplier s on n.n_nationkey = s.s_nationkey
                     ) s1 join lineitem l on s1.s_suppkey = l.l_suppkey
                  ) l1 on ps.ps_suppkey = l1.l_suppkey and ps.ps_partkey = l1.l_partkey
               ) l2 on p.p_name like '%green%' and p.p_partkey = l2.l_partkey
           ) l3 on o.o_orderkey = l3.l_orderkey
        )profit
      group by nation, o_year
      order by nation, o_year desc;
      
      ERROR: java.lang.IllegalArgumentException
      java.io.IOException: java.lang.IllegalArgumentException
      	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:152)
      	at org.apache.tajo.worker.Task.run(Task.java:446)
      	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:276)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IllegalArgumentException
      	at java.nio.Buffer.limit(Buffer.java:267)
      	at org.apache.tajo.storage.RawFile$RawFileScanner.fillBuffer(RawFile.java:154)
      	at org.apache.tajo.storage.RawFile$RawFileScanner.next(RawFile.java:263)
      	at org.apache.tajo.storage.MergeScanner.next(MergeScanner.java:95)
      	at org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:268)
      	at org.apache.tajo.engine.planner.physical.HashJoinExec.next(HashJoinExec.java:117)
      	at org.apache.tajo.engine.planner.physical.ProjectionExec.next(ProjectionExec.java:54)
      	at org.apache.tajo.engine.planner.physical.ProjectionExec.next(ProjectionExec.java:54)
      	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:107)
      	... 3 more
      

        Attachments

        1. TAJO-1097.jinho.patch
          2 kB
          Jinho Kim
        2. TAJO-1097_2.jinho.patch
          6 kB
          Jinho Kim

          Activity

            People

            • Assignee:
              mhthanh Mai Hai Thanh
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: