[SPARK-39973] Avoid noisy warnings logs when spark.scheduler.listenerbus.metrics.maxListenerClassesTimed = 0

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Spark Core
• Assignee: Hyukjin Kwon
• Reporter: Josh Rosen
• Created: 04/Aug/22 01:55
• Updated: 12/Dec/22 18:11
• Resolved: 08/Aug/22 09:59

Description

If spark.scheduler.listenerbus.metrics.maxListenerClassesTimed has been set to 0 to disable listener timers then listener registration will trigger noisy warnings like

LiveListenerBusMetrics: Not measuring processing time for listener class org.apache.spark.sql.util.ExecutionListenerBus because a maximum of 0 listener classes are already timed.

warnings.

We should change the code to not print this warning when maxListenerClassesTimed = 0.

I don't plan to work on this myself.

Issue Links

• links to: [Github] Pull Request #37432 (HyukjinKwon)