Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3415

improve MiniMRYarnCluster & DistributedShell JAR resolution

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 2.0.0-alpha
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Current JAR resolution assumes the following:

      1. The class used for JAR lookup is effectively in a JAR
      2. A System property is set for testing with the location of the JAR

      The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').

      The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)

      In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

        Attachments

        1. MAPREDUCE-3415.patch
          15 kB
          Alejandro Abdelnur
        2. MAPREDUCE-3415.patch
          14 kB
          Alejandro Abdelnur
        3. MAPREDUCE-3415.patch
          14 kB
          Alejandro Abdelnur
        4. MAPREDUCE-3415.patch
          15 kB
          Alejandro Abdelnur

          Issue Links

            Activity

              People

              • Assignee:
                tucu00 Alejandro Abdelnur
                Reporter:
                tucu00 Alejandro Abdelnur
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: