[SPARK-3771] AppendingParquetOutputFormat should use reflection to prevent from breaking binary-compatibility.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Takuya Ueshin
• Created: 02/Oct/14 23:34
• Updated: 13/Oct/14 20:43
• Resolved: 13/Oct/14 20:43

Description

Original problem is SPARK-3764.

AppendingParquetOutputFormat uses a binary-incompatible method context.getTaskAttemptID.
This causes binary-incompatible of Spark itself, i.e. if Spark itself is built against hadoop-1, the artifact is for only hadoop-1, and vice versa.

Issue Links

• relates to: SPARK-3764 Invalid dependencies of artifacts in Maven Central Repository.
• links to: [Github] Pull Request #2638 (ueshin)