Major Description
The current default of spark.yarn.scheduler.heartbeat.interval-ms is 5 seconds. This is really long. For reference, the MR equivalent is 1 second.
To avoid noise and unnecessary communication, we could have a fast rate for when we're waiting for executors and a slow rate for when we're just heartbeating.
