Details
Critical Description
I am trying to build Hadoop 2.7.2(direct from the upstream with no modifications) using OpenJDK 7 on Ubuntu 16.04(Xenial) but I get the following errors. The result is same with OpenJDK 8 but I switched back to OpenJDK 7 since its the recommended version. This is critical issue since I am unable to move beyond building Hadoop.
Other configuration details:
Protobuf: 2.5.0 (Built from source, backported aarch64 dependencies from 2.6)
Maven: 3.3.9
Command Line:
mvn package -Pdist -DskipTests -Dtar
Build log:
[INFO] Building jar: /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-auth-examples/target/hadoop-auth-examples-2.7.2-javadoc.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Common 2.7.2
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] — maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-common —
[INFO] Executing tasks
main:
[mkdir] Created dir: /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/target/test-dir
[mkdir] Created dir: /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/target/test/data
[INFO] Executed tasks
[INFO]
[INFO] — hadoop-maven-plugins:2.7.2:protoc (compile-protoc) @ hadoop-common —
[INFO]
[INFO] — hadoop-maven-plugins:2.7.2:version-info (version-info) @ hadoop-common —
[WARNING] [svn, info] failed with error code 1
[WARNING] [git, branch] failed with error code 128
[INFO] SCM: NONE
[INFO] Computed MD5: d0fda26633fa762bff87ec759ebe689c
[INFO]
[INFO] — maven-resources-plugin:2.6:resources (default-resources) @ hadoop-common —
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 7 resources
[INFO] Copying 1 resource
[INFO]
[INFO] — maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-common —
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 852 source files to /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/target/classes
An exception has occurred in the compiler (1.7.0_95). Please file a bug at the Java Developer Connection (http://java.sun.com/webapps/bugreport) after checking the Bug Parade for duplicates. Include your program and the following diagnostic in your report. Thank you.
java.lang.NullPointerException
at com.sun.tools.javac.tree.TreeInfo.skipParens(TreeInfo.java:571)
at com.sun.tools.javac.jvm.Gen.visitIf(Gen.java:1613)
at com.sun.tools.javac.tree.JCTree$JCIf.accept(JCTree.java:1140)
at com.sun.tools.javac.jvm.Gen.genDef(Gen.java:684)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:719)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:705)
at com.sun.tools.javac.jvm.Gen.genStats(Gen.java:756)
at com.sun.tools.javac.jvm.Gen.visitBlock(Gen.java:1031)
at com.sun.tools.javac.tree.JCTree$JCBlock.accept(JCTree.java:781)
at com.sun.tools.javac.jvm.Gen.genDef(Gen.java:684)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:719)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:705)
at com.sun.tools.javac.jvm.Gen.genLoop(Gen.java:1080)
at com.sun.tools.javac.jvm.Gen.visitForLoop(Gen.java:1051)
at com.sun.tools.javac.tree.JCTree$JCForLoop.accept(JCTree.java:872)
at com.sun.tools.javac.jvm.Gen.genDef(Gen.java:684)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:719)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:705)
at com.sun.tools.javac.jvm.Gen.genStats(Gen.java:756)
at com.sun.tools.javac.jvm.Gen.visitBlock(Gen.java:1031)
at com.sun.tools.javac.tree.JCTree$JCBlock.accept(JCTree.java:781)
at com.sun.tools.javac.jvm.Gen.genDef(Gen.java:684)
at com.sun.tools.javac.jvm.Gen.genStat(Gen.java:719)
at com.sun.tools.javac.jvm.Gen.genMethod(Gen.java:912)
at com.sun.tools.javac.jvm.Gen.visitMethodDef(Gen.java:885)
at com.sun.tools.javac.tree.JCTree$JCMethodDecl.accept(JCTree.java:669)
at com.sun.tools.javac.jvm.Gen.genDef(Gen.java:684)
at com.sun.tools.javac.jvm.Gen.genClass(Gen.java:2235)
at com.sun.tools.javac.main.JavaCompiler.genCode(JavaCompiler.java:712)
at com.sun.tools.javac.main.JavaCompiler.generate(JavaCompiler.java:1451)
at com.sun.tools.javac.main.JavaCompiler.generate(JavaCompiler.java:1419)
at com.sun.tools.javac.main.JavaCompiler.compile2(JavaCompiler.java:870)
at com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:829)
at com.sun.tools.javac.main.Main.compile(Main.java:439)
at com.sun.tools.javac.api.JavacTaskImpl.call(JavacTaskImpl.java:132)
at org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess(JavaxToolsCompiler.java:126)
at org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile(JavacCompiler.java:169)
at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute(AbstractCompilerMojo.java:785)
at org.apache.maven.plugin.compiler.CompilerMojo.execute(CompilerMojo.java:129)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
[INFO] -------------------------------------------------------------
[WARNING] COMPILATION WARNING :
[INFO] -------------------------------------------------------------
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java:[25,16] sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java:[50,19] sun.net.dns.ResolverConfiguration is internal proprietary API and may be removed in a future release
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java:[51,20] sun.net.util.IPAddressUtil is internal proprietary API and may be removed in a future release
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SignalLogger.java:[21,16] sun.misc.Signal is internal proprietary API and may be removed in a future release
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SignalLogger.java:[22,16] sun.misc.SignalHandler is internal proprietary API and may be removed in a future release
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SignalLogger.java:[44,43] sun.misc.SignalHandler is internal proprietary API and may be removed in a future release
[WARNING] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java:[46,16] sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[INFO] 7 warnings
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.480 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 4.389 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 13.507 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.599 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.802 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 13.952 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 10.358 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 16.305 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 13.822 s]
[INFO] Apache Hadoop Common ............................... FAILURE [ 20.604 s]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-server-sharedcachemanager .............. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Azure support ........................ SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:54 min
[INFO] Finished at: 2016-10-18T16:50:20+00:00
[INFO] Final Memory: 99M/1291M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project hadoop-common: Compilation failure: Compilation failure:
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/FastByteComparisons.java:[25,16] sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java:[50,19] sun.net.dns.ResolverConfiguration is internal proprietary API and may be removed in a future release
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java:[51,20] sun.net.util.IPAddressUtil is internal proprietary API and may be removed in a future release
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SignalLogger.java:[21,16] sun.misc.Signal is internal proprietary API and may be removed in a future release
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SignalLogger.java:[22,16] sun.misc.SignalHandler is internal proprietary API and may be removed in a future release
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SignalLogger.java:[44,43] sun.misc.SignalHandler is internal proprietary API and may be removed in a future release
[ERROR] /home/ubuntu/hadoop-2.7.2-src/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/nativeio/NativeIO.java:[46,16] sun.misc.Unsafe is internal proprietary API and may be removed in a future release
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common