Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6123

Limit batch size for Merge Join based on memory

    Details

      Description

      Merge join limits output batch size to 32K rows irrespective of row size. This can create very large or very small batches (in terms of memory), depending upon average row width. Change this to figure out output row count based on memory specified with the new outputBatchSize option and average row width of incoming left and right batches. Output row count will be minimum of 1 and max of 64k. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ppenumarthy Padma Penumarthy
                Reporter:
                ppenumarthy Padma Penumarthy
                Reviewer:
                Paul Rogers
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: