Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6164

Heap memory leak during parquet scan and OOM

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.13.0
    • Component/s: None
    • Labels:

      Description

      During a scan of a large set of parquet files, Drill iterates over the set initializing parquet readers. Such initialization may require a significant memory usage (both heap and direct). When scan moves to the next parquet file in the set, it does not remove reference to the reader from the set it iterates over and does not remove references created during initialization.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vrozov Vlad Rozov
                Reporter:
                vrozov Vlad Rozov
                Reviewer:
                Parth Chandra
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: