[HIVE-9993] Retrying task could use cached bad operators [Spark Branch]

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Fix Version/s: 1.2.0
• Assignee: Jimmy Xiang
• Reporter: Jimmy Xiang
• Created: 17/Mar/15 17:23
• Updated: 05/Jun/15 20:03
• Resolved: 17/Mar/15 20:25

Description

For a Spark task, it could be retried on the same executor in case some failures. In retrying, the cache task could be used. Since the operators in the task are already initialized, they won't be initialized again. The partial data in these operators could lead to wrong final results.