Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6147

Limit batch size for Flat Parquet Reader

    Details

      Description

      The Parquet reader currently uses a hard-coded batch size limit (32k rows) when creating scan batches; there is no parameter nor any logic for controlling the amount of memory used. This enhancement will allow Drill to take an extra input parameter to control direct memory usage.

        Attachments

          Activity

            People

            • Assignee:
              sachouche salim achouche
              Reporter:
              sachouche salim achouche
              Reviewer:
              Timothy Farkas
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: