Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2381

Build behind a proxy failing to fetch commons-daemon

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Won't Fix
    • Affects Version/s: 0.23.0, 0.24.0
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None
    • Environment:

      Linux box with a proxy to get to remote HTTP sites; ~/.m2/settings.xml set up with a proxy; ANT_OPTS set up with a proxy, both build tools downloading ivy/maven artifacts

    • Release Note:
      WONTFIXing as there is a workaround. I'd x-link to a Maven JIRA issue, but as that team doesn't use ASF JIRA for its issues, I won't

      Description

      The bit of Ant code in the HDFS project to D/L the commons-daemon binary is failing as it cannot reach archive.apache.org, even though Ant and Maven have their proxies setup. I will allege that M2 isn't passing proxy information down properly.

        Activity

        Hide
        Steve Loughran added a comment -

        build log
        [INFO] — maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ hadoop-hdfs —
        [INFO] Compiling 242 source files to /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/test-classes
        [INFO]
        [INFO] — maven-surefire-plugin:2.6:test (default-test) @ hadoop-hdfs —
        [INFO] Tests are skipped.
        [INFO]
        [INFO] — maven-antrun-plugin:1.6:run (xprepare-package-hadoop-daemon) @ hadoop-hdfs —
        [INFO] Executing tasks

        main:
        [mkdir] Created dir: /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/downloads/commons-daemon
        [get] Getting: http://archive.apache.org/dist/commons/daemon/binaries/1.0.3/linux/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz
        [get] To: /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/downloads/commons-daemon/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz
        [get] Error getting http://archive.apache.org/dist/commons/daemon/binaries/1.0.3/linux/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz to /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/downloads/commons-daemon/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz
        [INFO] ------------------------------------------------------------------------
        [INFO] Reactor Summary:
        [INFO]
        [INFO] Apache Hadoop Project POM ......................... SUCCESS [1.826s]
        [INFO] Apache Hadoop Annotations ......................... SUCCESS [1.378s]
        [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.318s]
        [INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.145s]
        [INFO] Apache Hadoop Auth ................................ SUCCESS [2.023s]
        [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [1.208s]
        [INFO] Apache Hadoop Common .............................. SUCCESS [16.450s]
        [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.067s]
        [INFO] Apache Hadoop HDFS ................................ FAILURE [32.423s]
        [INFO] Apache Hadoop HDFS Project ........................ SKIPPED
        [INFO] hadoop-yarn-api ................................... SKIPPED
        [INFO] hadoop-yarn-common ................................ SKIPPED
        [INFO] hadoop-yarn-server-common ......................... SKIPPED
        [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
        [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
        [INFO] hadoop-yarn-server-tests .......................... SKIPPED
        [INFO] hadoop-yarn-server ................................ SKIPPED
        [INFO] hadoop-yarn ....................................... SKIPPED
        [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
        [INFO] hadoop-mapreduce-client-common .................... SKIPPED
        [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
        [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
        [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
        [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
        [INFO] hadoop-mapreduce-client ........................... SKIPPED
        [INFO] hadoop-mapreduce .................................. SKIPPED
        [INFO] Apache Hadoop Main ................................ SKIPPED
        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD FAILURE
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 56.343s
        [INFO] Finished at: Wed Sep 28 15:43:30 BST 2011
        [INFO] Final Memory: 71M/286M
        [INFO] ------------------------------------------------------------------------
        [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (xprepare-package-hadoop-daemon) on project hadoop-hdfs: An Ant BuildException has occured: java.net.ConnectException: Connection timed out -> [Help 1]

        Show
        Steve Loughran added a comment - build log [INFO] — maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ hadoop-hdfs — [INFO] Compiling 242 source files to /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/test-classes [INFO] [INFO] — maven-surefire-plugin:2.6:test (default-test) @ hadoop-hdfs — [INFO] Tests are skipped. [INFO] [INFO] — maven-antrun-plugin:1.6:run (xprepare-package-hadoop-daemon) @ hadoop-hdfs — [INFO] Executing tasks main: [mkdir] Created dir: /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/downloads/commons-daemon [get] Getting: http://archive.apache.org/dist/commons/daemon/binaries/1.0.3/linux/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz [get] To: /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/downloads/commons-daemon/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz [get] Error getting http://archive.apache.org/dist/commons/daemon/binaries/1.0.3/linux/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz to /home/slo/Java/Hadoop/svn/hadoop-trunk/hadoop-hdfs-project/hadoop-hdfs/target/downloads/commons-daemon/commons-daemon-1.0.3-bin-linux-x86_64.tar.gz [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop Project POM ......................... SUCCESS [1.826s] [INFO] Apache Hadoop Annotations ......................... SUCCESS [1.378s] [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.318s] [INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.145s] [INFO] Apache Hadoop Auth ................................ SUCCESS [2.023s] [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [1.208s] [INFO] Apache Hadoop Common .............................. SUCCESS [16.450s] [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.067s] [INFO] Apache Hadoop HDFS ................................ FAILURE [32.423s] [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] hadoop-yarn-api ................................... SKIPPED [INFO] hadoop-yarn-common ................................ SKIPPED [INFO] hadoop-yarn-server-common ......................... SKIPPED [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED [INFO] hadoop-yarn-server-tests .......................... SKIPPED [INFO] hadoop-yarn-server ................................ SKIPPED [INFO] hadoop-yarn ....................................... SKIPPED [INFO] hadoop-mapreduce-client-core ...................... SKIPPED [INFO] hadoop-mapreduce-client-common .................... SKIPPED [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED [INFO] hadoop-mapreduce-client-app ....................... SKIPPED [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED [INFO] hadoop-mapreduce-client ........................... SKIPPED [INFO] hadoop-mapreduce .................................. SKIPPED [INFO] Apache Hadoop Main ................................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 56.343s [INFO] Finished at: Wed Sep 28 15:43:30 BST 2011 [INFO] Final Memory: 71M/286M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (xprepare-package-hadoop-daemon) on project hadoop-hdfs: An Ant BuildException has occured: java.net.ConnectException: Connection timed out -> [Help 1]
        Hide
        Steve Loughran added a comment -

        The workaround as it is clearly a fault of Maven, as a search shows this is not the first project to encounter it is to set the proxy settings on the command line of the build.

        mvn install -DskipTests -Dhttp.proxyHost=web-proxy -Dhttp.proxyPort=8080
        or, assuming you've set up ANT_OPTS to work
        mvn install $ANT_OPTS

        Show
        Steve Loughran added a comment - The workaround as it is clearly a fault of Maven, as a search shows this is not the first project to encounter it is to set the proxy settings on the command line of the build. mvn install -DskipTests -Dhttp.proxyHost=web-proxy -Dhttp.proxyPort=8080 or, assuming you've set up ANT_OPTS to work mvn install $ANT_OPTS
        Hide
        Steve Loughran added a comment -

        Better workaround
        alias m2sucks="mvn $ANT_OPTS"
        alias m2install="m2sucks install -DskipTests"
        alias m2test="m2sucks test"

        Show
        Steve Loughran added a comment - Better workaround alias m2sucks="mvn $ANT_OPTS" alias m2install="m2sucks install -DskipTests" alias m2test="m2sucks test"

          People

          • Assignee:
            Unassigned
            Reporter:
            Steve Loughran
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development