As of today there is no easy way to monitor the number of delayed messages.
One possibility is to use the getAllJobs() operation on JobScheduler MBean. But we have to specify a timeframe so it's quite difficult to use.
Instead, could we have a new JMX counter which provides the number of delayed messages ?