[SQOOP-1261] CompilationManager should add Hadoop 2.x libraries to the classpath under Hadoop 2.x

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.5

Environment

Hadoop 2.x

• Assignee: Venkat Ranganathan
• Reporter: Venkat Ranganathan
• Created: 13/Dec/13 21:24
• Updated: 15/Dec/13 23:21
• Resolved: 15/Dec/13 22:02

Description

The CompilationManager when compiling the generated Java file tries to add jar files that have JobConf fails if they are in the classpath, failing which adds hadoop-core.jar. hadoop-core.jar is not part of Hadoop 2.x. We need to add hadoop-common.jar and hadoop-mapred-client-core.jar

This situation is exasperated on Windows where the classpath presented to Sqoop actions under oozie does not have the full path but a uber jar because of command line length limitations and oozie sqoop jobs fail while compiling the generated jar files

Issue Links

• links to: review board link