Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4121

External Sort may not spill if above a receiver

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.5.0
    • Component/s: None
    • Labels:
      None

      Description

      If external sort is above a receiver, all received batches will contain non root buffers. Sort operator doesn't account for non root buffers when estimating how much memory and if it needs to spill to disk. This may delay the spill and cause the corresponding Drillbit to use large amounts of memory

        Attachments

          Activity

            People

            • Assignee:
              kkhatua Kunal Khatua
              Reporter:
              adeneche Abdel Hakim Deneche
              Reviewer:
              Kunal Khatua
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: