[SPARK-12921] Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.1
• Component/s: Spark Core, SQL
• Target Version/s: 1.6.1
• Assignee: Josh Rosen
• Reporter: Josh Rosen
• Created: 20/Jan/16 07:53
• Updated: 16/Feb/16 10:06
• Resolved: 16/Feb/16 10:06

Description

It looks like there's one place left in the codebase, SpecificParquetRecordReaderBase, where we didn't use SparkHadoopUtil's reflective accesses of TaskAttemptContext methods, creating problems when using a single Spark artifact with both Hadoop 1.x and 2.x.

Issue Links

• relates to: SPARK-10330 Use SparkHadoopUtil TaskAttemptContext reflection methods in more places
• links to: [Github] Pull Request #10843 (JoshRosen)
• links to: [Github] Pull Request #11131 (JoshRosen)