Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-6260

Drive _cmd config options by env var

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.10.6
    • Fix Version/s: 1.10.7
    • Component/s: configuration
    • Labels:
      None

      Description

      Add the ability to provide _CMD environment variables the same way you can use _cmd options in the configuration. Those _CMD environment variable would have priority against the _cmd options the same way the usual environment variables have priority against the configuration options.

      The goal is to allow Kubernetes users to provide such commands via configmap, and reference them in the configuration using environment variables. The referenced script would itself consume secrets in order to construct the connection.

      For exemple a script provided as a configmap and referenced by AIRFLOW_CORE_SQL_ALCHEMY_CONN_CMD would compute the Alchemy connection using the database user and password provided as secrets:

       

      #!/bin/bash

      echo -n "postgresql+psycopg2://`cat /var/run/secrets/postgresql/postgresql-user`:`cat /var/run/secrets/postgresql/postgresql-password`@$POSTGRESQL_SERVICE_HOST:$POSTGRESQL_SERVICE_PORT/airflow"

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nbardelot Noël BARDELOT
                Reporter:
                nbardelot Noël BARDELOT
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: