[IMPALA-821] Catalog Server consumes excessive cpu cycle

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 1.2.3
• Fix Version/s: Impala 1.3
• Assignee: Lenni Kuff
• Reporter: Alan Choi
• Created: 19/Feb/14 18:54
• Updated: 05/Mar/14 16:28
• Resolved: 05/Mar/14 16:28

Description

Catalog Server consumes excessive cpu cycle even at idle. On my local box (i7-2600 CPU @ 3.40GHz), ~5k tables will consume 5% of one cpu. The cpu cycles it consumes is directly proportional to the number of tables. So, if I've 100k tables, it'll consume 100% of one core.

I think the problem is inside UpdateCatalogTopicCallback where it loops through every single objects to compute the delta. There's definitely room for improvement.