Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7541

Avoid instantiating metrics for IncompleteTables

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Catalog
    • None
    • ghx-label-2

    Description

      Currently we instantiate a Metrics object for every table. However in many cases, users have hundreds of thousands or millions of tables and only a small subset are loaded. This is even more likely after the new automatic invalidation work in progress. So, we should try to minimize memory footprint of IncompleteTable. The largest culprit there seems to be the new Metrics object added by IMPALA-4886. We should lazily init this only on loaded tables.

      Attachments

        Activity

          People

            vihangk1 Vihang Karajgaonkar
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: