Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
Impala 1.2.3
-
None
-
None
Description
Catalog Server consumes excessive cpu cycle even at idle. On my local box (i7-2600 CPU @ 3.40GHz), ~5k tables will consume 5% of one cpu. The cpu cycles it consumes is directly proportional to the number of tables. So, if I've 100k tables, it'll consume 100% of one core.
I think the problem is inside UpdateCatalogTopicCallback where it loops through every single objects to compute the delta. There's definitely room for improvement.