[SPARK-12481] Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: DStreams, Spark Core, SQL
• Target Version/s: 2.0.0
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 22/Dec/15 16:59
• Updated: 02/Jan/16 13:15
• Resolved: 02/Jan/16 13:15

Description

Many API calls that were deprecated as of Hadoop 2.2 can be fixed now to use the non-deprecated methods. Also, some reflection-based acrobatics to support 2.x and 1.x can be removed now too.

Issue Links

• relates to: SPARK-11807 Remove support for Hadoop < 2.2 (i.e. Hadoop 1 and 2.0)
• links to: [Github] Pull Request #10446 (srowen)