Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-803 Fault Tolerance In Tez
  3. TEZ-781

Add unit test for fault tolerance (input failure causes re-run of previous task under allowed maximum failed attempt)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.3.0
    • 0.3.0
    • None
    • None

    Description

      Add a unit test for tez fault tolerance.

      /**

      • Test input failure.
      • v1-task0 v1-task1
      • \ /
      • v2-task0 v2-task1
      • Use maximum allowed failed attempt of 4 (default value during session creation).
      • v1-task1-attempt0 fails. Attempt 1 succeeds.
      • v2-task0-attempt0 runs. Its input1-inputversion0 fails.
      • This will trigger rerun of v1-task1.
      • v1-task1-attempt2 is re-run and succeeds.
      • v2-task0-attempt0 (no attempt bump) runs. Check its input1.
      • The input version is now 1. The attempt will now succeed.
      • @throws Exception
        */

      Attachments

        1. TEZ-781.patch
          3 kB
          Tassapol Athiapinya
        2. TEZ-781.2.patch
          2 kB
          Tassapol Athiapinya
        3. TEZ-781.3.patch
          3 kB
          Tassapol Athiapinya
        4. TEZ-781.4.patch
          3 kB
          Tassapol Athiapinya
        5. TEZ-781.5.patch
          9 kB
          Bikas Saha
        6. TEZ-781.6.patch
          4 kB
          Tassapol Athiapinya
        7. TEZ-781.7.patch
          4 kB
          Tassapol Athiapinya
        8. TEZ-781.8.patch
          4 kB
          Bikas Saha

        Issue Links

          Activity

            People

              tassapola Tassapol Athiapinya
              tassapola Tassapol Athiapinya
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: