Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3415

improve MiniMRYarnCluster & DistributedShell JAR resolution

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 0.24.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Current JAR resolution assumes the following:

      1. The class used for JAR lookup is effectively in a JAR
      2. A System property is set for testing with the location of the JAR

      The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').

      The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)

      In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

      1. MAPREDUCE-3415.patch
        15 kB
        Alejandro Abdelnur
      2. MAPREDUCE-3415.patch
        14 kB
        Alejandro Abdelnur
      3. MAPREDUCE-3415.patch
        14 kB
        Alejandro Abdelnur
      4. MAPREDUCE-3415.patch
        15 kB
        Alejandro Abdelnur

        Issue Links

          Activity

          Gavin made changes -
          Link This issue depends upon MAPREDUCE-3169 [ MAPREDUCE-3169 ]
          Gavin made changes -
          Link This issue depends on MAPREDUCE-3169 [ MAPREDUCE-3169 ]
          Gavin made changes -
          Link This issue is depended upon by HADOOP-7590 [ HADOOP-7590 ]
          Gavin made changes -
          Link This issue blocks HADOOP-7590 [ HADOOP-7590 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Alejandro Abdelnur made changes -
          Fix Version/s 0.24.0 [ 12317654 ]
          Alejandro Abdelnur made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Alejandro Abdelnur made changes -
          Attachment MAPREDUCE-3415.patch [ 12504097 ]
          Alejandro Abdelnur made changes -
          Attachment MAPREDUCE-3415.patch [ 12504012 ]
          Alejandro Abdelnur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Alejandro Abdelnur made changes -
          Attachment MAPREDUCE-3415.patch [ 12503949 ]
          Alejandro Abdelnur made changes -
          Link This issue depends on MAPREDUCE-3169 [ MAPREDUCE-3169 ]
          Alejandro Abdelnur made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Alejandro Abdelnur made changes -
          Link This issue blocks HADOOP-7590 [ HADOOP-7590 ]
          Alejandro Abdelnur made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Alejandro Abdelnur made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-3415.patch [ 12503947 ]
          Alejandro Abdelnur created issue -

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development