-
Type:
Bug
-
Status: Open
-
Priority:
Major
-
Resolution: Unresolved
-
Affects Version/s: 0.20.205.0
-
Fix Version/s: None
-
Component/s: contrib/eclipse-plugin
-
Labels:
-
Environment:
windows7,Eclipse3.7.1,hadoop-0.20.205.0 on CentOs6.0
I found tow problems in the eclipse plugin.
1.Plugin's build path is missing jar ,when I use DFSView, it will report java.lang.NoClassDefFoundError exception as follow:
java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils
java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration
I add commons-lang-2.4.jar and commons-configuration-1.6.jar, and it works.
2.The job configuration may be overrided by default conf when it submited. Run log as follow:
11/12/14 10:55:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" java.io.IOException: Failed to set permissions of path: \usr\local\hadoop\hadooptmp205\mapred\staging\storm-75040524\.staging to 0700
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:484)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:319)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:848)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:842)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Unknown Source)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:842)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
The point is that Job found a wrong fs, it was LocalFileSystem.
By my configuration, job should be run on HDFS, but the conf which named "mapred.job.tracker" was overrided by default value.