Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
ghx-label-14
Description
The design of IMPALA-6636 currently follow existing algorithm in hdfs-parquet-scanner for computing ideal memory reservation for each column.
We can refine this computation for ORC by checking orc::Reader::getMemoryUseByTypeId once the file reader has read the metadata in footer.