Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
ghx-label-6
Description
HdfsScanNode.computeMinScalarColumnMemReservation has estimate to reduce memory reservation for a column lower than DEFAULT_COLUMN_SCAN_RANGE_RESERVATION (4MB).
https://github.com/apache/impala/blob/df528fe/fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java#L2226-L2235
This estimate is based on Parquet table. We need to revisit this estimate for ORC table.