[MAPREDUCE-3555] hadoop 0.20.205.0 Eclipse Plugin does not work with Eclipse,there are two problems with it.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.20.205.0
• Component/s: contrib/eclipse-plugin
• Labels: hadoop

Environment

windows7,Eclipse3.7.1,hadoop-0.20.205.0 on CentOs6.0

• Assignee: Unassigned
• Reporter: Storm Lee
• Created: 14/Dec/11 03:44
• Updated: 25/Dec/11 20:01

Description

I found tow problems in the eclipse plugin.
1.Plugin's build path is missing jar ,when I use DFSView, it will report java.lang.NoClassDefFoundError exception as follow:

java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils

java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

I add commons-lang-2.4.jar and commons-configuration-1.6.jar, and it works.

2.The job configuration may be overrided by default conf when it submited. Run log as follow:

11/12/14 10:55:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" java.io.IOException: Failed to set permissions of path: \usr\local\hadoop\hadooptmp205\mapred\staging\storm-75040524\.staging to 0700
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:484)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:319)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:848)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:842)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:842)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)

The point is that Job found a wrong fs, it was LocalFileSystem.
By my configuration, job should be run on HDFS, but the conf which named "mapred.job.tracker" was overrided by default value.