Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
A team working on Arrow benchmarks encountered a problem where the mimalloc allocator was holding onto considerably more RAM than needed (at least 6GB and potentially more).
Mimalloc offers the `mi_collect` non-standard API which forces mimalloc to release unused pages to the OS. We could expose this to be called by benchmarking tools to get consistent results and reduce the amount of RAM needed.
Attachments
Issue Links
- links to