Description
This can be useful for debugging memory issues.
Metrics that can be possibly added:
1. Log memory usage after say every 50M data has been loaded
2. Add a counter for number of write buffers already allocated
3. Log a snapshot of partitions (memory usage for each of them)