Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-274

Spooling batch buffer

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.4.0
    • None
    • None

    Description

      incoming batches are currently queued up and held in memory without limit. If execution on a node is delayed, or is not able keep up with the rate of incoming batches, this could result in out of memory errors. We want to allow spooling incoming batches to disk once the total size of the batches in the queue reaches a threshold.

      Attachments

        1. DRILL-274_2013-11-18_17:57:41.patch
          76 kB
          Steven Phillips
        2. DRILL-274_2013-11-18_17:12:34.patch
          76 kB
          Steven Phillips
        3. DRILL-274.patch
          67 kB
          Steven Phillips
        4. DRILL-274.patch
          67 kB
          Steven Phillips

        Activity

          People

            sphillips Steven Phillips
            sphillips Steven Phillips
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: