Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
ghx-label-2
Description
Currently we instantiate a Metrics object for every table. However in many cases, users have hundreds of thousands or millions of tables and only a small subset are loaded. This is even more likely after the new automatic invalidation work in progress. So, we should try to minimize memory footprint of IncompleteTable. The largest culprit there seems to be the new Metrics object added by IMPALA-4886. We should lazily init this only on loaded tables.