Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-6806

Kubernetes Executor : Sometimes, task is succeeded, but pod is not completed ( keep running ) . Zombie pod is born.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Not A Bug
    • Affects Version/s: 1.10.9
    • Fix Version/s: None
    • Labels:
      None

      Description

      The task completes successfully, and the result is able to check on the UI. However, there are cases where the Pod that was processing a completed task is keep running and will not end forever. A zombie pod is born.

       

      Use Operator like this,

      default_pod = BashOperator(

              task_id="test",

              env=KubePodEnv,

              retries=1,

              xcom_push=True,

              bash_command="python3 /opt/test.py ",

              executor_config={

                  "KubernetesExecutor":

                                   

      {   "volumes": volumes,                                                       "volume_mounts": volume_mounts,                                                     "affinity":affinity,                   }

                                },

              dag=dag

              )

        Attachments

          Activity

            People

            • Assignee:
              dimberman Daniel Imberman
              Reporter:
              Yuya Matsubara Yuya
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: