Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-6395

[AIP-28] Add AsyncExecutor option

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.10.7
    • Fix Version/s: None
    • Component/s: core, executors, operators, scheduler
    • Labels:
      None

      Description

      Add an AsyncExecutor that is similar to LocalExecutor but designed to optimize for high concurrency with async behavior for any blocking operations.  It requires an async ecosystem and general flags for async operations on hooks, operators, and sensors.

      Further details can be developed in an AIP and this description can be updated with links to relevant resources and discussion(s).

      https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-28%3A+Add+AsyncExecutor+option

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                dazza Darren Weber
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: