[HBASE-8438] Extend bin/hbase to print a "mapreduce classpath"

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.94.6.1, 0.95.0, 0.94.13
• Fix Version/s: 0.98.0, 0.96.1, 0.94.14
• Component/s: scripts
• Hadoop Flags: Reviewed

Release Note

$ ./bin/hbase mapredcp --help
Usage: hbase mapredcp [-Dtmpjars=...]
  Construct a CLASSPATH containing dependency jars required to run a mapreduce job. By default, includes any jars detected by TableMapReduceUtils. Provide additional entries by specifying a comma-separated list in tmpjars.

• Assignee: Nick Dimiduk
• Reporter: Nick Dimiduk
• Created: 25/Apr/13 18:10
• Updated: 26/Nov/13 05:53
• Resolved: 17/Nov/13 21:00

Description

For tools like pig and hive, blindly appending the full output of `bin/hbase classpath` to their own CLASSPATH is excessive. They already build CLASSPATH entries for hadoop. All they need from us is the delta entries, the dependencies we require w/o hadoop and all of it's transitive deps. This is also a kindness for Windows, where there's a shorter limit on the length of commandline arguments.

See also HIVE-2055 for additional discussion.

Issue Links

• relates to: HIVE-2055 Hive should add HBase classpath dependencies when available