[HBASE-3873] Mavenize Hadoop Snappy JAR/SOs project dependencies

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.90.2
• Fix Version/s: 0.92.0
• Component/s: build
• Labels: build

Environment

Linux

• Hadoop Flags: Reviewed
• Release Note: Add support to hbase for snappy compression.
• Assignee: Alejandro Abdelnur
• Reporter: Alejandro Abdelnur
• Created: 10/May/11 16:29
• Updated: 20/Nov/15 12:43
• Resolved: 06/Jun/11 23:17

Description

(This JIRA builds on HBASE-3691)

I'm working on simplifying how to use Hadoop Snappy from other based maven projects. The idea is that hadoop-snappy JAR and the SOs (snappy and hadoop-snappy) would be picked up from a Maven repository (like any other dependencies). SO files will be picked up based on the architecture where the build is running (32 or 64 bits).

For Hbase this would remove the need to manually copy snappy JAR and SOs (snappy and hadoop-snappy) into HADOOP_HOME/lib or HBASE_HOME/lib and hadoop-snappy would be handled as a regular maven dependency (with a trick for the SOs file).

The changes would affect only the pom.xml and the would be in a 'snappy' profile, thus requiring '-Dsnappy' option in Maven invocations to trigger the including of snappy JAR and SOs.

Because hadoop-snappy (JAR and SOs) are not currently avail in public Maven repos, until that happens, Hbase developer would have to checkout and 'mvn install' hadoop-snappy. Which is (IMO) simpler than what will have to be done in once HBASE-3691 is committed.

Issue Links

• depends upon: HBASE-3691 Add compressor support for 'snappy', google's compressor
• is depended upon by: HBASE-3930 test snappy compression works within Hbase tests