[HBASE-6581] Build with hadoop.profile=3.0

• Type: Umbrella
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Hadoop Flags: Reviewed
• Release Note: Make us build against hadoop trunk (3.0)
• Assignee: Eric Charles
• Reporter: Eric Charles
• Created: 14/Aug/12 13:01
• Updated: 13/Jun/22 19:03
• Resolved: 05/Jul/17 20:04

Description

Building trunk with hadoop.profile=3.0 gives exceptions (see [1]) due to change in the hadoop maven modules naming (and also usage of 3.0-SNAPSHOT instead of 3.0.0-SNAPSHOT in hbase-common).

I can provide a patch that would move most of hadoop dependencies in their respective profiles and will define the correct hadoop deps in the 3.0 profile.

Please tell me if that's ok to go this way.

Thx, Eric

[1]
$ mvn clean install -Dhadoop.profile=3.0
[INFO] Scanning for projects...
[ERROR] The build could not read 3 projects -> [Help 1]
[ERROR]
[ERROR] The project org.apache.hbase:hbase-server:0.95-SNAPSHOT (/d/hbase.svn/hbase-server/pom.xml) has 3 errors
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 655, column 21
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 659, column 21
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 663, column 21
[ERROR]
[ERROR] The project org.apache.hbase:hbase-common:0.95-SNAPSHOT (/d/hbase.svn/hbase-common/pom.xml) has 3 errors
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 170, column 21
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 174, column 21
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 178, column 21
[ERROR]
[ERROR] The project org.apache.hbase:hbase-it:0.95-SNAPSHOT (/d/hbase.svn/hbase-it/pom.xml) has 3 errors
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-common:jar is missing. @ line 220, column 18
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-annotations:jar is missing. @ line 224, column 21
[ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 228, column 21
[ERROR]

Issue Links

• blocks: OOZIE-2973 Make sure Oozie works with Hadoop 3
• is depended upon by: YARN-2032 Implement a scalable, available TimelineStore using HBase
• is related to: HBASE-17925 mvn assembly:single fails against hadoop3-alpha2
• relates to: HBASE-16711 Fix hadoop-3.0 profile compile
• relates to: HBASE-16712 fix hadoop-3.0 profile mvn install

Sub-Tasks

• Change sync to hsync, remove unused InfoServer, and reference our httpserver instead of hadoops: Closed