[DRILL-3779] NPE during mergeAndSpill operation of external sort

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: Execution - Relational Operators
• Assignee: Aman Sinha
• Reporter: Aman Sinha
• Created: 14/Sep/15 17:51
• Updated: 18/Sep/15 15:06
• Resolved: 18/Sep/15 15:06

Description

For a query of the following pattern:

alter session set `planner.enable_hashjoin` = false;
alter session set `planner.width.max_per_node` = 6;
select 
   t1.c1, t1.c2....t1.c50 
  from t1 left outer join t2 on ..
   left outer join t3  on ...
   left outer join t4 on ...
   left outer join t5 on ...
where t2.col between t1.c1 and t1.c2

we get an NPE below. The dataset is large so I cannot attach it here. Will try to get a repro with smaller data.

java.sql.SQLException: SYSTEM ERROR: NullPointerException

Fragment 5:0

[Error Id: 3df8da3d-dee2-45d4-9a0a-abaa0ab3775e on se-node11.se.lab:31010]

  (java.lang.NullPointerException) null
    org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.getBufferSize():523
    org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.mergeAndSpill():461
    org.apache.drill.exec.physical.impl.xsort.ExternalSortBatch.innerNext():334
    org.apache.drill.exec.record.AbstractRecordBatch.next():147
    org.apache.drill.exec.record.AbstractRecordBatch.next():105
    org.apache.drill.exec.record.AbstractRecordBatch.next():95
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
    org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext():92
    org.apache.drill.exec.record.AbstractRecordBatch.next():147
    org.apache.drill.exec.record.AbstractRecordBatch.next():105
    org.apache.drill.exec.physical.impl.join.JoinStatus.nextLeft():127
    org.apache.drill.exec.physical.impl.join.JoinStatus.ensureInitial():143
    org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():171
    org.apache.drill.exec.record.AbstractRecordBatch.next():147
    org.apache.drill.exec.record.AbstractRecordBatch.next():105
    org.apache.drill.exec.record.AbstractRecordBatch.next():95
    org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51