HBase
  1. HBase
  2. HBASE-8140

TableMapReduceUtils#addDependencyJar fails when nested inside another MR job

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.0, 0.95.0
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job to make sure dependencies of the job are shipped to the cluster. The code depends on finding an actual jar file containing the necessary classes. This is not always the case, for instance, when run at the end of another mapreduce job. In that case, dependency jars have already been shipped to the cluster and expanded in the parent job's run folder. Those dependencies are there, just not available as jars.

      1. 0001-HBASE-8140-addendum-add-test-category.patch
        2 kB
        Nick Dimiduk
      2. 8140-port-jarfinder-trunk.patch
        17 kB
        Nick Dimiduk
      3. 8140-port-jarfinder-0.94.patch
        17 kB
        Nick Dimiduk

        Issue Links

          Activity

            People

            • Assignee:
              Nick Dimiduk
              Reporter:
              Nick Dimiduk
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development