HBase
  1. HBase
  2. HBASE-8140

TableMapReduceUtils#addDependencyJar fails when nested inside another MR job

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.0, 0.95.0
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job to make sure dependencies of the job are shipped to the cluster. The code depends on finding an actual jar file containing the necessary classes. This is not always the case, for instance, when run at the end of another mapreduce job. In that case, dependency jars have already been shipped to the cluster and expanded in the parent job's run folder. Those dependencies are there, just not available as jars.

      1. 0001-HBASE-8140-addendum-add-test-category.patch
        2 kB
        Nick Dimiduk
      2. 8140-port-jarfinder-0.94.patch
        17 kB
        Nick Dimiduk
      3. 8140-port-jarfinder-trunk.patch
        17 kB
        Nick Dimiduk

        Issue Links

          Activity

          stack made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Nick Dimiduk made changes -
          Link This issue is related to HBASE-8158 [ HBASE-8158 ]
          stack made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.94.7 [ 12324039 ]
          Resolution Fixed [ 1 ]
          Nick Dimiduk made changes -
          Nick Dimiduk made changes -
          Link This issue is related to HBASE-8147 [ HBASE-8147 ]
          Enis Soztutar made changes -
          Link This issue is related to HBASE-8146 [ HBASE-8146 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.98.0 [ 12323143 ]
          Fix Version/s 0.94.7 [ 12324039 ]
          Nick Dimiduk made changes -
          Attachment 8140-port-jarfinder-0.94.patch [ 12574356 ]
          Attachment 8140-port-jarfinder-trunk.patch [ 12574357 ]
          Nick Dimiduk made changes -
          Link This issue is related to HCATALOG-623 [ HCATALOG-623 ]
          Sushanth Sowmyan made changes -
          Field Original Value New Value
          Link This issue relates to HCATALOG-623 [ HCATALOG-623 ]
          Nick Dimiduk created issue -

            People

            • Assignee:
              Nick Dimiduk
              Reporter:
              Nick Dimiduk
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development