[MAPREDUCE-6704] Update the documents to run MapReduce application

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha2
• Component/s: documentation
• Target Version/s: 3.0.0-alpha2
• Hadoop Flags: Reviewed
• Assignee: Bibin Chundatt
• Reporter: Bibin Chundatt
• Created: 02/May/16 13:18
• Updated: 22/Aug/17 18:38
• Resolved: 22/Dec/16 19:50

Description

Container fail to launch for mapred application.
As part for launch script HADOOP_MAPRED_HOME default value is not set .After https://github.com/apache/hadoop/commit/9d4d30243b0fc9630da51a2c17b543ef671d035c HADOOP_MAPRED_HOME is not able to get from builder.environment() since DefaultContainerExecutor#buildCommandExecutor sets inherit to false.

16/05/02 09:16:05 INFO mapreduce.Job: Job job_1462155939310_0004 failed with state FAILED due to: Application application_1462155939310_0004 failed 2 times due to AM Container for appattempt_1462155939310_0004_000002 exited with  exitCode: 1
Failing this attempt.Diagnostics: Exception from container-launch.
Container id: container_1462155939310_0004_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
        at org.apache.hadoop.util.Shell.run(Shell.java:850)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:227)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option UseSplitVerifier; support was removed in 8.0
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option UseSplitVerifier; support was removed in 8.0

Issue Links

• duplicates: MAPREDUCE-6783 Default setting 'inheritParentEnv=false' caused mr executor failed to initialize
• relates to: MAPREDUCE-6941 The default setting doesn't work for MapReduce job
• relates to: MAPREDUCE-6702 TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing
• relates to: YARN-5877 Allow all env's from yarn.nodemanager.env-whitelist to get overridden during launch