[HBASE-8140] TableMapReduceUtils#addDependencyJar fails when nested inside another MR job

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.98.0, 0.95.0
• Component/s: mapreduce
• Hadoop Flags: Reviewed
• Assignee: Nick Dimiduk
• Reporter: Nick Dimiduk
• Created: 18/Mar/13 19:28
• Updated: 23/Sep/13 18:31
• Resolved: 20/Mar/13 04:13

Description

TableMapReduceUtils#addDependencyJar is used when configuring a mapreduce job to make sure dependencies of the job are shipped to the cluster. The code depends on finding an actual jar file containing the necessary classes. This is not always the case, for instance, when run at the end of another mapreduce job. In that case, dependency jars have already been shipped to the cluster and expanded in the parent job's run folder. Those dependencies are there, just not available as jars.

Issue Links

• is related to: HBASE-8147 Add Integration Test for "The HCat Scenario"
• is related to: HBASE-8146 IntegrationTestBigLinkedList does not work on distributed setup
• is related to: HBASE-8158 Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job"
• is related to: HCATALOG-623 Understanding how to use the HBase bulk import feature
• relates to: HCATALOG-623 Understanding how to use the HBase bulk import feature