Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2859

mapreduce trunk is broken with eclipse plugin contrib

    Details

      Description

      ant compile with eclipse home fails mapreduce trunk builds.

      $ANT_HOME/bin/ant -Dversion=$

      {VERSION}

      -Declipse.home=$ECLIPSE_HOME compile

      compile:
      [echo] contrib: eclipse-plugin
      [javac] Compiling 45 source files to /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/contrib/eclipse-plugin/classes
      [javac] /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/eclipse-plugin/src/java/org/apache/hadoop/eclipse/server/HadoopServer.java:39: cannot find symbol
      [javac] symbol : class JobClient
      [javac] location: package org.apache.hadoop.mapred
      [javac] import org.apache.hadoop.mapred.JobClient;
      [javac] ^


      [javac] JobConf conf = new JobConf(location.getConfiguration());
      [javac] ^
      [javac] Note: Some input files use or override a deprecated API.
      [javac] Note: Recompile with -Xlint:deprecation for details.
      [javac] Note: Some input files use unchecked or unsafe operations.
      [javac] Note: Recompile with -Xlint:unchecked for details.
      [javac] 49 errors

      BUILD FAILED
      /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build.xml:451: The following error occurred while executing this line:
      /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/build.xml:30: The following error occurred while executing this line:
      /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/src/contrib/eclipse-plugin/build.xml:62: Compile failed; see the compiler error output for details.

      1. MAPREDUCE-2859.patch
        2 kB
        Giridharan Kesavan

        Activity

        Hide
        Vinod Kumar Vavilapalli added a comment -

        The JobConf, JobClient and a whole bunch of classes moved to the hadoop-mr-client/hadoop-mapreduce-client-core maven module. Locally we install these modules and then go ahead with compilation via ant.

        We can take one of the two steps: (1) Follow the same steps in Jenkins scripts to first install the maven modules locally and then run ant (2) Publish all the new mapreduce maven modules to apache maven repositories.

        Giri, comment on which one's the easier path? (2) definitely is the correct path, I think, but I am not sure who/what publishes the modules (for e.g. common) to maven repos.

        Show
        Vinod Kumar Vavilapalli added a comment - The JobConf, JobClient and a whole bunch of classes moved to the hadoop-mr-client/hadoop-mapreduce-client-core maven module. Locally we install these modules and then go ahead with compilation via ant. We can take one of the two steps: (1) Follow the same steps in Jenkins scripts to first install the maven modules locally and then run ant (2) Publish all the new mapreduce maven modules to apache maven repositories. Giri, comment on which one's the easier path? (2) definitely is the correct path, I think, but I am not sure who/what publishes the modules (for e.g. common) to maven repos.
        Hide
        Giridharan Kesavan added a comment -

        For now approach (1) should be fine; as we need to aggregate the number of jar files that yarn has to publish to maven repo before publishing the jar files.

        Show
        Giridharan Kesavan added a comment - For now approach (1) should be fine; as we need to aggregate the number of jar files that yarn has to publish to maven repo before publishing the jar files.
        Hide
        Giridharan Kesavan added a comment -

        This patch fixes the eclipse plugin compilation issue.

        Show
        Giridharan Kesavan added a comment - This patch fixes the eclipse plugin compilation issue.
        Hide
        Arun C Murthy added a comment -

        +1

        Thanks for taking care of this Giri!

        Show
        Arun C Murthy added a comment - +1 Thanks for taking care of this Giri!
        Hide
        Giridharan Kesavan added a comment -

        I just committed this , Thanks Arun

        Show
        Giridharan Kesavan added a comment - I just committed this , Thanks Arun
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #774 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/774/)
        MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan

        gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml
        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml
        • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
        • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #774 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/774/ ) MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #777 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/777/)
        MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan

        gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml
        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml
        • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
        • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #777 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/777/ ) MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #764 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/764/)
        MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan

        gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml
        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml
        • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
        • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #764 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/764/ ) MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #784 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/784/)
        MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan

        gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml
        • /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml
        • /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml
        • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #784 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/784/ ) MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan gkesavan : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160987 Files : /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/src/contrib/eclipse-plugin/build.xml /hadoop/common/trunk/hadoop-mapreduce/ivy/ivysettings.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt

          People

          • Assignee:
            Giridharan Kesavan
            Reporter:
            Giridharan Kesavan
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development