[HADOOP-9771] Improve instructions for Eclipse with m2e plugin in http://wiki.apache.org/hadoop/EclipseEnvironment

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.0.5-alpha, 3.0.0-alpha1
• Component/s: documentation
• Labels: wiki

Environment

Cent OS 6.4

• Release Note: This is not for Hadoop 1.x branches
• Assignee: Unassigned
• Reporter: German Florez-Larrahondo
• Created: 25/Jul/13 15:14
• Updated: 12/May/16 18:25

Description

The instructions for using Eclipse with Hadoop 2.0x or trunk seem a bit out of date. I recently setup Eclipse with the m2e plugin without major issues (in contrast, the wiki calls it a 'giant mess').

I think we should have instructions for both the m2e plugin and with more static mvn eclipse:eclipse option as in the current wiki.

Below I add a raw log of the steps I took. If I get granted write access to this wiki page I could do a nice write-up of this if the team agrees with the updates (my wiki name is GermanFlorezLarrahondo)

Regards

Raw log of activities to compile Hadoop in Eclipse using m2e pluging (As of July 25 2013):

-Using trunk (http://svn.apache.org/repos/asf/hadoop/common/trunk), Last Changed Date: 2013-07-24 10:00:50 -0400 (Wed, 24 Jul 2013)

-first built by hand via CLI using mvn -o -X $ANT_OPTS clean package -Pdist,native,docs,src -DskipTests -Dtar

-Follow most of the instructions in here http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/

-In particular, for a clean build the proper protocol buffers and avro autogenerated Java files must be linked to some of the Hadoop projects (via buid path/link source, adding patter */.java).

Hadoop-common:
hadoop-common-project/hadoop-common/target/generated-test-sources/java
hadoop-common-project/hadoop-common/target/generated-sources/java

Hadoop-hdfs:
hadoop-hdfs-project/hadoop-hdfs/target/generated-sources/java

Hadoop-hdfs-bkjournal:
hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/target/generated-sources/java

Hadoop-mapreduce-client-app:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/target/generated-sources/avro

Hadoop-mapreduce-client-common:
/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/target/generated-sources/java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/target/generated-sources/java

Hadoop-mapreduceclient-hs:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/target/generated-sources/java

Hadoop-yarn-api:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/target/generated-sources

Hadoop-yarn-common:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/target/generated-sources/java

Hadoop-yarn-server-common:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/target/generated-sources/java

Hadoop-yarn-server-nodemanager:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/generated-sources/java