Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3555

hadoop 0.20.205.0 Eclipse Plugin does not work with Eclipse,there are two problems with it.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.205.0
    • Fix Version/s: None
    • Component/s: contrib/eclipse-plugin
    • Labels:
    • Environment:

      windows7,Eclipse3.7.1,hadoop-0.20.205.0 on CentOs6.0

      Description

      I found tow problems in the eclipse plugin.
      1.Plugin's build path is missing jar ,when I use DFSView, it will report java.lang.NoClassDefFoundError exception as follow:

      java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils

      java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

      I add commons-lang-2.4.jar and commons-configuration-1.6.jar, and it works.

      2.The job configuration may be overrided by default conf when it submited. Run log as follow:

      11/12/14 10:55:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      Exception in thread "main" java.io.IOException: Failed to set permissions of path: \usr\local\hadoop\hadooptmp205\mapred\staging\storm-75040524\.staging to 0700
      at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
      at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
      at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:484)
      at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:319)
      at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
      at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:848)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:842)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Unknown Source)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:842)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)

      The point is that Job found a wrong fs, it was LocalFileSystem.
      By my configuration, job should be run on HDFS, but the conf which named "mapred.job.tracker" was overrided by default value.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ccstorm Storm Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: