Major We are currently using Airflow at Skyscanner and we have a custom implementation of Statsd which offers features which wires in nicely into our metrics platform/tooling.
I'm quite sure that other companies who are using Airflow would also find great benefit in being able to utilise their own custom Statsd client, therefore i am proposing this addition.
The proposed solution looks something along the lines of changing this:
statsd = StatsClient(
host=conf.get('scheduler', 'statsd_host'),
port=conf.getint('scheduler', 'statsd_port'),
prefix=conf.get('scheduler', 'statsd_prefix'))
Into
statsd = conf.get('STATSD_CLIENT') or StatsClient( host=conf.get('scheduler', 'statsd_host'), port=conf.getint('scheduler', 'statsd_port'), prefix=conf.get('scheduler', 'statsd_prefix'))
Note: Psuedocode, not actual code