Uploaded image for project: 'Apache Airflow'
  1. Apache Airflow
  2. AIRFLOW-5006

Need task_failures audit trail for failed run in metastore db even after running 'clear' results in next DagRun successful

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.10.3, 1.10.5
    • Fix Version/s: None
    • Component/s: database
    • Labels:
      None
    • Environment:
      mysql RDS metastore, localexecutor

      Description

      if a dagrun fails (and so some rows go to task_fail table in metastore) but then after running 'clear' from cli to restart the dagrun (and its successful run) the rows from metastore's task_fail table get deleted. is this expected? or is there some way i can keep history of all failures in metastore?

       

      even history of old successful runs are lost when doing clear for same exec date

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                toopt4 t oo
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: