Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-7116

Tasks get stuck in the "removed" state

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.10.9
    • Fix Version/s: None
    • Component/s: DAG
    • Labels:
    • Environment:
      Mac OS Catalina
      Airflow 1.10.9
      Airflow running locally using out of box sqlite database

      Description

      This appears to be a regression of:

       

      https://issues.apache.org/jira/browse/AIRFLOW-1460

       

      Repro steps:

       

      1. Configure Dag to run within context manager via "with" keyword.
      2. Comment out one or more tasks within a Dag.
      3. Refresh Dag.
      4. Trigger Dag.
      5. Notice the tasks are removed from the dag and the dag runs the non-commented task(s) successfully.
      6. Uncomment the tasks that were commented before.
      7. refresh dag.
      8. trigger dag.

       

      Observed results:

      • The tree view of the dag does not update, showing the re-added tasks.
      • After Triggering the Dag, (only the task(s) that was/were tested while the others were commented out appears in the Graph View)
      • On the graph view, the dag's uncommented tasks only appear after restarting Airflow Server/Scheduler.
      • Even though the Airflow server was restarted, and although the dag now shows all the tasks in both Tree view and Graph view, the dag, when triggered, only runs the task(s) that were previously not commented. 
      • Note that the tasks when hovering mouse over them in Graph View, show "State" as "removed".

       

       

       

        Attachments

        1. Untitled.png
          93 kB
          Chris

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              cdabel Chris
            • Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: