[SPARK-23033] disable task-level retry for continuous execution

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Structured Streaming
• Target Version/s: 2.3.0
• Assignee: Jose Torres
• Reporter: Jose Torres
• Created: 11/Jan/18 00:02
• Updated: 13/Jul/18 05:30
• Resolved: 17/Jan/18 21:53

Description

Continuous execution tasks shouldn't retry independently, but rather use the global restart mechanism. Retrying will execute from the initial offset at the time the task was created, which is very bad.

Issue Links

• links to: [Github] Pull Request #20225 (jose-torres)
• links to: [Github] Pull Request #20675 (xuanyuanking)