[SPARK-6369] InsertIntoHiveTable and Parquet Relation should use logic from SparkHadoopWriter

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.3.1, 1.4.0
• Component/s: SQL
• Target Version/s: 1.3.1, 1.4.0
• Assignee: Cheng Lian
• Reporter: Michael Armbrust
• Created: 17/Mar/15 00:01
• Updated: 30/Mar/15 23:52
• Resolved: 30/Mar/15 23:52

Description

Right now it is possible that we will corrupt the output if there is a race between competing speculative tasks.

Issue Links

• relates to: SPARK-6067 Spark sql hive dynamic partitions job will fail if task fails
• links to: [Github] Pull Request #5139 (liancheng)