Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13465

Add a task failure listener to TaskContext

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.2, 2.0.0
    • Component/s: SQL
    • Labels:
      None
    • Target Version/s:

      Description

      TaskContext supports task completion callback, which gets called regardless of task failures. However, there is no way for the listener to know if there is an error. This ticket proposes adding a new listener that gets called when a task fails.

        Attachments

          Activity

            People

            • Assignee:
              rxin Reynold Xin
              Reporter:
              rxin Reynold Xin
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: