Details

    • Type: Task
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: release
    • Labels:

      Description

      Release the airflow 1.7.1 tag.

      Current status:
      There are three issues blocking this release caused by this commit:
      https://github.com/apache/incubator-airflow/commit/fb0c5775cda4f84c07d8d5c0e6277fc387c172e6
      1. DAGs with a lot of tasks take much longer to parse (~25x slowdown)
      2. The following kind of patterns fail:

      email.set_upstream(dag.roots)
      dag.add_task(email)
      

      This is because set_upstream now calls add_task and a task can't be added more than once.
      3. Airflow losing queued tasks (see linked issue)
      4. Airflow putting dags in a stuck state (AIRFLOW-92)

      I'm working with the owner of the commit to resolve these issues.

      The way to catch (1) in the future is an integration test that asserts a given non-trivial DAG parses under X seconds

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                aoen Dan Davydov
                Reporter:
                aoen Dan Davydov
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: