[HADOOP-7726] eclipse target does not build with 0.24.0

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 0.24.0
• Component/s: build

Environment

Fedora 15

• Assignee: Unassigned
• Reporter: Tim Broberg
• Created: 07/Oct/11 03:57
• Updated: 23/Jul/12 05:21
• Resolved: 23/Jul/12 05:21

Description

I'm new to hadoop, java, and eclipse, so please forgive me if I jumble multiple issues together or mistake the symptoms of one problem for a separate issue.

Attempting to follow the build instructions from http://wiki.apache.org/hadoop/EclipseEnvironment, the following commands are to be executed:

1 - mvn test -DskipTests
2 - mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true
3 - cd hdfs; ant compile eclipse
4 - cd ../; cd mapreduce; ant compile eclipse

A - If "mvn test -DskipTests" is used for #1, #2 fails with "[ERROR] Failed to execute goal on project hadoop-yarn-common: Could not resolve dependencies for project org.apache.hadoop:hadoop-yarn-common:jar:0.24.0-SNAPSHOT:"

Per Luke Lu's suggestion, "mvn install -DskipTests -P-cbuild" instead of step #1 cleared up this issue.

B - For steps #3, and #4 there are no hdfs or mapreduce subdirectories. These appear to have been renamed "hadoop-hdfs-project" and "hadoop-mapreduce-project".

C - For step #3, if I then go to hadoop-hdfs-project instead and perform "ant compile eclipse" no build.xml file is found - "Buildfile: build.xml does not exist!"

D - For step #4, if I go to hadoop-mapreduce-project and do "ant compile eclipse" a set of errors much like #A is produced:

> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve] ::
> org.apache.hadoop#hadoop-yarn-server-common;0.24.0-SNAPSHOT: not found
> [ivy:resolve] ::
> org.apache.hadoop#hadoop-mapreduce-client-core;0.24.0-SNAPSHOT: not found
> [ivy:resolve] ::
> org.apache.hadoop#hadoop-yarn-common;0.24.0-SNAPSHOT: not found
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::

E - If I ignore these issues and import the projects generated in step #2, I get a bunch of errors related to the lack of an M2_REPO definition. Adding this variable needs to be included in the build scripts or documentation in the wiki.

F - Once that is resolved, eclipse shows hundreds of errors and warnings starting with "AvroRecord" cannot be resolved to a type.

Thanks so much for your work on this, but it needs a little more effort in documentation and/or development before it is usable again.

Thanks.