Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-1641

Task gets stuck in queued state

    XMLWordPrintableJSON

    Details

    • Flags:
      Important

      Description

      Hello,

      I have one dag with ~20 tasks.
      The dags runs daily and some tasks can sometime last for hours, depending on the processed data behind.
      There are some interactions with AWS and a remote DB.
      I only use LocalExecutor.

      What this issue is about, is the fact that sometime (randomly, and without any clear reason) one of the tasks (here also, it is random) gets stuck in "queued" state and never starts running.
      The manual workaround is to restart the task manually by clearing it.

      Does anyone have ideas about the issue behind, and how to avoid it for the future?
      Thanks in advance for your help.

      PS: other people are facing the same behaviour: link

        Attachments

          Activity

            People

            • Assignee:
              bolke Bolke de Bruin
              Reporter:
              mas Michael Smith
            • Votes:
              4 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: