Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3779

NPE during mergeAndSpill operation of external sort

    Details

      Description

      For a query of the following pattern:

      alter session set `planner.enable_hashjoin` = false;
      alter session set `planner.width.max_per_node` = 6;
      select 
         t1.c1, t1.c2....t1.c50 
        from t1 left outer join t2 on ..
         left outer join t3  on ...
         left outer join t4 on ...
         left outer join t5 on ...
      where t2.col between t1.c1 and t1.c2
      

      we get an NPE below. The dataset is large so I cannot attach it here. Will try to get a repro with smaller data.

      java.sql.SQLException: SYSTEM ERROR: NullPointerException
      
      Fragment 5:0
      
      [Error Id: 3df8da3d-dee2-45d4-9a0a-abaa0ab3775e on se-node11.se.lab:31010]
      
        (java.lang.NullPointerException) null
          org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.getBufferSize():523
          org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.mergeAndSpill():461
          org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext():334
          org.apache.drill.exec.record.AbstractRecordBatch.next():147
          org.apache.drill.exec.record.AbstractRecordBatch.next():105
          org.apache.drill.exec.record.AbstractRecordBatch.next():95
          org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
          org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext():92
          org.apache.drill.exec.record.AbstractRecordBatch.next():147
          org.apache.drill.exec.record.AbstractRecordBatch.next():105
          org.apache.drill.exec.physical.impl.join.JoinStatus.nextLeft():127
          org.apache.drill.exec.physical.impl.join.JoinStatus.ensureInitial():143
          org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():171
          org.apache.drill.exec.record.AbstractRecordBatch.next():147
          org.apache.drill.exec.record.AbstractRecordBatch.next():105
          org.apache.drill.exec.record.AbstractRecordBatch.next():95
          org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
      

        Attachments

          Activity

            People

            • Assignee:
              amansinha100 Aman Sinha
              Reporter:
              amansinha100 Aman Sinha
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: