Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1779

Handle race condition for failure after success of a leaf vertex task

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Currently, a leaf task is not expected to fail after success because tasks fail after success only when outputs are reported failed and noone can report a leaf vertex output as failed because noone reads it. However, as discussed in TEZ-14, there can be a case where 2 attempts are running and 1 succeeds. Then the second one is killed but it fails before getting killed. This failure would break the cannot fail after success assumption that currently is present in the code. Does the leaf vertex need special handling anyways?

      Attachments

        Activity

          People

            Unassigned Unassigned
            bikassaha Bikas Saha
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: