Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The ant build target doesn't work in the hadoop-mapreduce directory since the mavenization of hdfs changes were checked in.

      Error it gives is:
      [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
      [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
      [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
      [ivy:resolve] :: org.apache.avro#avro-ipc;working@host: not found
      [ivy:resolve] :: org.apache.hadoop#hadoop-alfredo;working@host: not found
      [ivy:resolve] :: commons-daemon#commons-daemon;working@host: not found
      [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::

      Steps I followed:
      check out trunk
      build common/hdfs: mvn clean install -Pbintar -DskipTests
      build yarn/mapred:
      mvn clean install assembly:assembly -DskipTests
      ant veryclean tar -Dresolvers=internal ----> this fails

        Issue Links

          Activity

          Hide
          Thomas Graves added a comment -

          Cleaning .ivy got rid of that one but still get this error:
          build.xml:374: taskdef class org.apache.avro.specific.ProtocolTask cannot be found

          Show
          Thomas Graves added a comment - Cleaning .ivy got rid of that one but still get this error: build.xml:374: taskdef class org.apache.avro.specific.ProtocolTask cannot be found
          Hide
          Mahadev konar added a comment -

          This fixes the issues with the build also includes the avro upgrade in MAPREDUCE-2848. Am uploading a single patch then both are related.

          Show
          Mahadev konar added a comment - This fixes the issues with the build also includes the avro upgrade in MAPREDUCE-2848 . Am uploading a single patch then both are related.
          Hide
          Arun C Murthy added a comment -

          +1 lgtm

          Show
          Arun C Murthy added a comment - +1 lgtm
          Hide
          Mahadev konar added a comment -

          Just pushed this. Thanks to Arun and Giri for helping me with this!

          Show
          Mahadev konar added a comment - Just pushed this. Thanks to Arun and Giri for helping me with this!
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk-Commit #845 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/845/)
          MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #845 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/845/ ) MAPREDUCE-2868 . ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456 Files : /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Common-trunk-Commit #767 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/767/)
          MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Show
          Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #767 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/767/ ) MAPREDUCE-2868 . ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456 Files : /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Hide
          Sharad Agarwal added a comment -

          Still seeing the same problem:
          [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
          [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
          [ivy:resolve] :: org.apache.avro#avro-ipc;working@host: not found
          [ivy:resolve] :: org.apache.hadoop#hadoop-alfredo;working@host: not found

          Anybody else seeing it ?

          Show
          Sharad Agarwal added a comment - Still seeing the same problem: [ivy:resolve] :: UNRESOLVED DEPENDENCIES :: [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: [ivy:resolve] :: org.apache.avro#avro-ipc;working@host: not found [ivy:resolve] :: org.apache.hadoop#hadoop-alfredo;working@host: not found Anybody else seeing it ?
          Hide
          Thomas Graves added a comment -

          did you try cleaning out your ~/.ivy2 directory? I saw it until I did that.

          Show
          Thomas Graves added a comment - did you try cleaning out your ~/.ivy2 directory? I saw it until I did that.
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Hdfs-trunk #763 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/763/)
          MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Show
          Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #763 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/763/ ) MAPREDUCE-2868 . ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456 Files : /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #779 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/779/)
          MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)

          mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456
          Files :

          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce/ivy.xml
          • /hadoop/common/trunk/hadoop-mapreduce/build.xml
          • /hadoop/common/trunk/hadoop-mapreduce/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java
          • /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties
          • /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #779 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/779/ ) MAPREDUCE-2868 . ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1160456 Files : /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/pom.xml /hadoop/common/trunk/hadoop-mapreduce/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce/ivy.xml /hadoop/common/trunk/hadoop-mapreduce/build.xml /hadoop/common/trunk/hadoop-mapreduce/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/pom.xml /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventWriter.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/AvroYarnRPC.java /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/EventReader.java /hadoop/common/trunk/hadoop-mapreduce/ivy/libraries.properties /hadoop/common/trunk/hadoop-mapreduce/hadoop-mr-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithHistoryService.java
          Hide
          Arun C Murthy added a comment -

          Sharad, if that works for you, please close this. Thanks.

          Show
          Arun C Murthy added a comment - Sharad, if that works for you, please close this. Thanks.
          Hide
          Sharad Agarwal added a comment -

          Cleaning the ~/.ivy2 did the trick. Thanks for the pointer Thomas.

          Show
          Sharad Agarwal added a comment - Cleaning the ~/.ivy2 did the trick. Thanks for the pointer Thomas.

            People

            • Assignee:
              Mahadev konar
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development