Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10353

Fix hadoop-hdfs-native-client compilation on Windows

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: build
    • Labels:
      None
    • Environment:

      windows

      Description

      After HADOOP-12892,,hadoop-hdfs-native-client compilation failing by throwing the following...

      F:\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target\antrun\build-main.xml
      [ERROR] -> [Help 1]
      org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-hdfs-native-client: An Ant BuildException has occured: F:\GitCode\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target\native\target\bin\RelWithDebInfo does not exist.
      around Ant part ...<copy todir="F:\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target/bin">... @ 14:98 in F:\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target\antrun\build-main.xml
              at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
              at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
              at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
              at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
              at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
              at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
              at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
              at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317)
              at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152)
              at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
              at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
              at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:606)
              at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
              at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
              at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
              at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
      Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildException has occured: F:\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target\native\target\bin\RelWithDebInfo does not exist.
      around Ant part ...<copy todir="F:\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target/bin">... @ 14:98 in F:\Trunk\hadoop\hadoop-hdfs-project\hadoop-hdfs-native-client\target\antrun\build-main.xml
              at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:355)
              at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106)
              at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
              ... 19 more
      
      1. HDFS-10353.patch
        0.9 kB
        Brahma Reddy Battula

        Issue Links

          Activity

          Hide
          brahmareddy Brahma Reddy Battula added a comment -

          Uploaded the patch kindly review..

          Show
          brahmareddy Brahma Reddy Battula added a comment - Uploaded the patch kindly review..
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 11m 41s Docker mode activated.
          +1 @author 0m 1s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 mvninstall 6m 38s trunk passed
          +1 compile 0m 13s trunk passed with JDK v1.8.0_91
          +1 compile 0m 15s trunk passed with JDK v1.7.0_95
          +1 mvnsite 0m 15s trunk passed
          +1 mvneclipse 0m 12s trunk passed
          +1 javadoc 0m 9s trunk passed with JDK v1.8.0_91
          +1 javadoc 0m 10s trunk passed with JDK v1.7.0_95
          +1 mvninstall 0m 10s the patch passed
          +1 compile 0m 10s the patch passed with JDK v1.8.0_91
          +1 javac 0m 10s the patch passed
          +1 compile 0m 12s the patch passed with JDK v1.7.0_95
          +1 javac 0m 12s the patch passed
          +1 mvnsite 0m 12s the patch passed
          +1 mvneclipse 0m 10s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 xml 0m 0s The patch has no ill-formed XML file.
          +1 javadoc 0m 7s the patch passed with JDK v1.8.0_91
          +1 javadoc 0m 8s the patch passed with JDK v1.7.0_95
          +1 unit 0m 29s hadoop-hdfs-native-client in the patch passed with JDK v1.8.0_91.
          +1 unit 0m 30s hadoop-hdfs-native-client in the patch passed with JDK v1.7.0_95.
          +1 asflicense 0m 19s Patch does not generate ASF License warnings.
          23m 45s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:cf2ee45
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12801692/HDFS-10353.patch
          JIRA Issue HDFS-10353
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml
          uname Linux c84c6b27995d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 971af60
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15335/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15335/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 11m 41s Docker mode activated. +1 @author 0m 1s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 6m 38s trunk passed +1 compile 0m 13s trunk passed with JDK v1.8.0_91 +1 compile 0m 15s trunk passed with JDK v1.7.0_95 +1 mvnsite 0m 15s trunk passed +1 mvneclipse 0m 12s trunk passed +1 javadoc 0m 9s trunk passed with JDK v1.8.0_91 +1 javadoc 0m 10s trunk passed with JDK v1.7.0_95 +1 mvninstall 0m 10s the patch passed +1 compile 0m 10s the patch passed with JDK v1.8.0_91 +1 javac 0m 10s the patch passed +1 compile 0m 12s the patch passed with JDK v1.7.0_95 +1 javac 0m 12s the patch passed +1 mvnsite 0m 12s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 xml 0m 0s The patch has no ill-formed XML file. +1 javadoc 0m 7s the patch passed with JDK v1.8.0_91 +1 javadoc 0m 8s the patch passed with JDK v1.7.0_95 +1 unit 0m 29s hadoop-hdfs-native-client in the patch passed with JDK v1.8.0_91. +1 unit 0m 30s hadoop-hdfs-native-client in the patch passed with JDK v1.7.0_95. +1 asflicense 0m 19s Patch does not generate ASF License warnings. 23m 45s Subsystem Report/Notes Docker Image:yetus/hadoop:cf2ee45 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12801692/HDFS-10353.patch JIRA Issue HDFS-10353 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml uname Linux c84c6b27995d 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 971af60 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_91 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15335/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-native-client U: hadoop-hdfs-project/hadoop-hdfs-native-client Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15335/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          andrew.wang Andrew Wang added a comment -

          Thanks for the find+fix Brahma! Patch LGTM. I do not have a Windows env to test, but will trust you on this one

          Show
          andrew.wang Andrew Wang added a comment - Thanks for the find+fix Brahma! Patch LGTM. I do not have a Windows env to test, but will trust you on this one
          Hide
          andrew.wang Andrew Wang added a comment -

          Thanks again Brahma for the find and fix, committed to trunk.

          Show
          andrew.wang Andrew Wang added a comment - Thanks again Brahma for the find and fix, committed to trunk.
          Hide
          brahmareddy Brahma Reddy Battula added a comment -

          Andrew Wang thanks for commit...

          Show
          brahmareddy Brahma Reddy Battula added a comment - Andrew Wang thanks for commit...
          Hide
          ajisakaa Akira Ajisaka added a comment -

          HADOOP-12892 was backported to branch-2 and branch-2.8, so this commit should be backported as well. What do you think, Brahma Reddy Battula and Andrew Wang?

          Show
          ajisakaa Akira Ajisaka added a comment - HADOOP-12892 was backported to branch-2 and branch-2.8, so this commit should be backported as well. What do you think, Brahma Reddy Battula and Andrew Wang ?
          Hide
          cnauroth Chris Nauroth added a comment -

          Akira Ajisaka, you are correct. I cherry-picked it to branch-2 and branch-2.8. I confirmed that both branches build the distro successfully on Windows.

          Show
          cnauroth Chris Nauroth added a comment - Akira Ajisaka , you are correct. I cherry-picked it to branch-2 and branch-2.8. I confirmed that both branches build the distro successfully on Windows.
          Hide
          andrew.wang Andrew Wang added a comment -

          For future git log greppers, I forgot to put the JIRA ID in the commit message. My mistake.

          Show
          andrew.wang Andrew Wang added a comment - For future git log greppers, I forgot to put the JIRA ID in the commit message. My mistake.

            People

            • Assignee:
              brahmareddy Brahma Reddy Battula
              Reporter:
              brahmareddy Brahma Reddy Battula
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development