[HBASE-18240] Add hbase-thirdparty, a project with hbase utility including an hbase-shaded-thirdparty module with guava, netty, etc.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: dependencies, shading
• Hadoop Flags: Reviewed

Release Note

Adds a new project, hbase-thirdparty, at https://git-wip-us.apache.org/repos/asf/hbase-thirdparty used by core hbase. GroupID org.apache.hbase.thirdparty. Version 1.0.0.

This project packages relocated third-party libraries used by Apache HBase such as protobuf, guava, and netty among others. HBase core depends on it.

It has threre submodules, one to patch and then relocate (shade) protobuf, and one to do messy .so renaming (netty). The remainder module relocates a bundle of other (unpatched) libs used by hbase. This latter set includes protobuf-util, netty-all, gson, and guava.

All shading is done using the same relocation offset of org.apache.hadoop.hbase.shaded; we add this prefix to the relocated thirdparty library class names.

See the pom.xml in hbase-thirdparty for the explicit version of each third-party lib included (of note, we update out internal protobuf from 3.1.0 to 3.3.1).

• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 20/Jun/17 01:21
• Updated: 05/Jul/17 16:29
• Resolved: 05/Jul/17 16:24

Description

This issue is about adding a new related project to host hbase auxillary utility. In this new project, the first thing we'd add is a module to host shaded versions of third party libraries.

This task comes of discussion held here http://apache-hbase.679495.n3.nabble.com/DISCUSS-More-Shading-td4083025.html where one conclusion of the DISCUSSION was "... pushing this part forward with some code is the next logical step. Seems to be consensus about taking our known internal dependencies and performing this shade magic."

Issue Links

• is depended upon by: HBASE-17056 Remove checked in PB generated files