[PIG-3285] Jobs using HBaseStorage fail to ship dependency jars

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Assignee: Nick Dimiduk
• Reporter: Nick Dimiduk
• Created: 19/Apr/13 23:30
• Updated: 07/Jul/14 18:07
• Resolved: 24/Nov/13 23:45

Description

Launching a job consuming HBaseStorage fails out of the box. The user must specify -Dpig.additional.jars for HBase and all of its dependencies. Exceptions look something like this:

2013-04-19 18:58:39,360 FATAL org.apache.hadoop.mapred.Child: Error running child : java.lang.NoClassDefFoundError: com/google/protobuf/Message
	at org.apache.hadoop.hbase.io.HbaseObjectWritable.<clinit>(HbaseObjectWritable.java:266)
	at org.apache.hadoop.hbase.ipc.Invocation.write(Invocation.java:139)
	at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.sendParam(HBaseClient.java:612)
	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:975)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:84)
	at $Proxy7.getProtocolVersion(Unknown Source)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:136)
	at org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:208)

Issue Links

• is related to: HBASE-8386 deprecate TableMapReduce.addDependencyJars(Configuration, class<?> ...)
• is related to: PIG-2786 enhance Pig launcher script wrt. HBase/HCat integration