Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-821

Catalog Server consumes excessive cpu cycle

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 1.2.3
    • Impala 1.3
    • None
    • None

    Description

      Catalog Server consumes excessive cpu cycle even at idle. On my local box (i7-2600 CPU @ 3.40GHz), ~5k tables will consume 5% of one cpu. The cpu cycles it consumes is directly proportional to the number of tables. So, if I've 100k tables, it'll consume 100% of one core.

      I think the problem is inside UpdateCatalogTopicCallback where it loops through every single objects to compute the delta. There's definitely room for improvement.

      Attachments

        Activity

          People

            lskuff Lenni Kuff
            alan@cloudera.com Alan Choi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: