Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3415

improve MiniMRYarnCluster & DistributedShell JAR resolution

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 2.0.0-alpha
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Current JAR resolution assumes the following:

      1. The class used for JAR lookup is effectively in a JAR
      2. A System property is set for testing with the location of the JAR

      The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').

      The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)

      In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

      1. MAPREDUCE-3415.patch
        15 kB
        Alejandro Abdelnur
      2. MAPREDUCE-3415.patch
        14 kB
        Alejandro Abdelnur
      3. MAPREDUCE-3415.patch
        14 kB
        Alejandro Abdelnur
      4. MAPREDUCE-3415.patch
        15 kB
        Alejandro Abdelnur

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development