[YARN-6546] SLS is slow while loading 10k queues

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha2
• Fix Version/s: 3.0.0
• Component/s: scheduler-load-simulator
• Assignee: Yufei Gu
• Reporter: Yufei Gu
• Created: 02/May/17 18:35
• Updated: 18/Oct/17 00:04
• Resolved: 17/Oct/17 23:19

Description

It takes a long time (more than 10 minutes) to load 10k queues in SLS. The problem should be in com.codahale.metrics.CsvReporter based on the result from profiler. SLS creates 14 .csv files for each leaf queue, and update them constantly during execution. It is not necessary to log information for inactive queues.