Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6537

Limit the batch size for buffering operators based on how much memory they get

    Details

      Description

      we are using 16MB for output batch size for all operators by default. however, for buffering operators, depending upon how much memory they get allocated, it is possible that 16MB might be too much to use for output batch size, causing them to spill sometimes.

      Have output batch size to be minimum of 16 MB or 20% of the allocated memory.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ppenumarthy Padma Penumarthy
                Reporter:
                ppenumarthy Padma Penumarthy
                Reviewer:
                Boaz Ben-Zvi
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: