Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-2715

Dataflow template operator dosenot support region parameter

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.9.0
    • Fix Version/s: 1.10.3
    • Component/s: operators
    • Labels:
      None

      Description

      The DataflowTemplateOperator  uses dataflow.projects.templates.launch which has a region parameter but only supports execution of the dataflow job in the us-central1 region. Alternatively  there is another api, dataflow.projects.locations.templates.launch which supports execution of the template in all regional endpoints provided by google cloud.

      It would be great if,

      1. The base REST API of this operator could be changed from "dataflow.projects.templates.launch" to "dataflow.projects.locations.templates.launch"
      2. A templated region paramter was included in the operator to run the dataflow job in the requested regional endpoint.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              salad_king Mohammed Tameem
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: