Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-5854

IllegalStateException when empty batch is received.

    XMLWordPrintableJSON

Details

    Description

      When we get a batch with record count 0 and empty schema from one of the senders in the merge receiver,
      the following exception is thrown sometimes.

      Problem is that merge receiver is reading from the wrong sender when first batch is empty from one of the senders.
      When first batch is empty, we are continuing without moving to the next sender.

      Error: SYSTEM ERROR: IllegalStateException: Cleanup before finished. 0 out of 1 streams have finished

      Fragment 0:0

      [Error Id: 0dec4617-eb06-48fd-80c9-75e9c1e74ce2 on sidrill1:31010]

      (java.lang.IllegalStateException) Cleanup before finished. 0 out of 1 streams have finished
      org.apache.drill.exec.work.batch.BaseRawBatchBuffer.close():107
      org.apache.drill.common.AutoCloseables.close():76
      org.apache.drill.common.AutoCloseables.close():64
      org.apache.drill.exec.work.batch.AbstractDataCollector.close():119
      org.apache.drill.common.AutoCloseables.close():76
      org.apache.drill.exec.work.batch.IncomingBuffers.close():140
      org.apache.drill.exec.ops.FragmentContext.suppressingClose():436
      org.apache.drill.exec.ops.FragmentContext.close():429
      org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources():320
      org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup():155
      org.apache.drill.exec.work.fragment.FragmentExecutor.run():264
      org.apache.drill.common.SelfCleaningRunnable.run():38
      java.util.concurrent.ThreadPoolExecutor.runWorker():1149
      java.util.concurrent.ThreadPoolExecutor$Worker.run():624
      java.lang.Thread.run():748 (state=,code=0)

      Attachments

        Issue Links

          Activity

            People

              ppenumarthy Padma Penumarthy
              ppenumarthy Padma Penumarthy
              Paul Rogers Paul Rogers
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: