Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7219

7.5% of Catalog Server heap wasted by empty HashMaps and ArrayLists

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:
      None
    • Epic Color:
      ghx-label-2

      Description

      I recently analyzed a ~16GB heap dump of Catalog Server with jxray (www.jxray.com). It turns out that 7.5% of the heap is wasted by empty HashMap and ArrayList instances.

      These objects come from just four data fields in two classes: IncompleteTable and StructType. It should be easy to get rid of the overhead of these objects by initializing them lazily.

       

        Attachments

        1. bad-colls-screenshot.png
          206 kB
          Misha Dmitriev

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              misha@cloudera.com Misha Dmitriev
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: