Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-5508

Whitelist mechanism for StatsD metrics

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.10.5
    • Fix Version/s: 1.10.6
    • Component/s: scheduler
    • Labels:
      None

      Description

      Sometimes we don't need that all available metrics be sent to StatsD server when only a particular subset is relevant (e.g. scheduler or pool).

      One of the reasons for filtering out metrics is because some of them are based on dag ids, creating high cardinality metrics in the StatsD server, leading into scalability issues in an environment with many dags.

      This feature aims to give the users the ability to control which metrics should be sent via whitelisting, keeping the default behavior of sending all if not specified.

        Attachments

          Activity

            People

            • Assignee:
              mike_dias Mike Dias
              Reporter:
              mike_dias Mike Dias
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: