[MAPREDUCE-3415] improve MiniMRYarnCluster & DistributedShell JAR resolution

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.1, 2.0.0-alpha
• Fix Version/s: 0.23.1
• Component/s: mrv2
• Hadoop Flags: Reviewed
• Assignee: Alejandro Abdelnur
• Reporter: Alejandro Abdelnur
• Created: 16/Nov/11 20:19
• Updated: 10/Mar/15 04:32
• Resolved: 17/Nov/11 23:21

Description

Current JAR resolution assumes the following:

1. The class used for JAR lookup is effectively in a JAR
2. A System property is set for testing with the location of the JAR

The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').

The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)

In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

Issue Links

• depends upon: MAPREDUCE-3169 Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2
• is depended upon by: HADOOP-7590 Mavenize streaming and MR examples