Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6853

Parquet Complex Reader for nested schema should have configurable memory or max records to fetch

    Details

      Description

      Parquet Complex reader while fetching nested schema should have configurable memory or max records to fetch and not default to 4000 records.

      While scanning TB of data with wider columns, this could easily cause OOM issues. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sachouche salim achouche
                Reporter:
                nitin.sharma Nitin Sharma
                Reviewer:
                Timothy Farkas
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: