[BIGTOP-3628] Hadoop YARN Job Failure

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: hadoop
• Assignee: Unassigned
• Reporter: Buğra Çakır
• Created: 06/Jan/22 17:03
• Updated: 06/Jan/22 17:03

Description

Hadoop MRV2 or YARN job execution fails with the below error..

$ su yarn -c 'yarn jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-3.2.2.jar pi 1 1000'

Number of Maps  = 1
Samples per Map = 1000
Wrote input for Map #0
Starting Job
2022-01-06 19:38:31,913 INFO client.RMProxy: Connecting to ResourceManager at bd06.xxx.local/10.1.1.68:8032
2022-01-06 19:38:32,119 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /user/yarn/.staging/job_1641484703580_0003
2022-01-06 19:38:32,197 INFO input.FileInputFormat: Total input files to process : 1
2022-01-06 19:38:32,238 INFO mapreduce.JobSubmitter: number of splits:1
2022-01-06 19:38:32,336 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1641484703580_0003
2022-01-06 19:38:32,337 INFO mapreduce.JobSubmitter: Executing with tokens: []
2022-01-06 19:38:32,457 INFO conf.Configuration: resource-types.xml not found
2022-01-06 19:38:32,457 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2022-01-06 19:38:32,515 INFO impl.YarnClientImpl: Submitted application application_1641484703580_0003
2022-01-06 19:38:32,547 INFO mapreduce.Job: The url to track the job: http://bd06.xxx.local:20888/proxy/application_1641484703580_0003/
2022-01-06 19:38:32,548 INFO mapreduce.Job: Running job: job_1641484703580_0003
2022-01-06 19:38:37,604 INFO mapreduce.Job: Job job_1641484703580_0003 running in uber mode : false
2022-01-06 19:38:37,606 INFO mapreduce.Job:  map 0% reduce 0%
2022-01-06 19:38:37,626 INFO mapreduce.Job: Job job_1641484703580_0003 failed with state FAILED due to: Application application_1641484703580_0003 failed 2 times due to AM Container for appattempt_1641484703580_0003_000002 exited with  exitCode: 1
Failing this attempt.Diagnostics: [2022-01-06 19:38:36.975]Exception from container-launch.
Container id: container_1641484703580_0003_02_000001
Exit code: 1
Exception message: Launch container failed
Shell output: main : command provided 1
main : run as user is yarn
main : requested yarn user is yarn
Getting exit code file...
Creating script paths...
Writing pid file...
Writing to tmp file /data/2/yarn/nmPrivate/application_1641484703580_0003/container_1641484703580_0003_02_000001/container_1641484703580_0003_02_000001.pid.tmp
Writing to cgroup task files...
Creating local dirs...
Launching container...

[2022-01-06 19:38:36.982]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class 3276

[2022-01-06 19:38:36.983]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class 3276

For more detailed output, check the application tracking page: http://bd06.xxx.local:8088/cluster/app/application_1641484703580_0003 Then click on links to logs of each attempt.
. Failing the application.
2022-01-06 19:38:37,645 INFO mapreduce.Job: Counters: 0
Job job_1641484703580_0003 failed!

 --