[MAPREDUCE-5842] uber job with LinuxContainerExecutor cause exception

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: mrv2
• Assignee: Unassigned
• Reporter: Atkins
• Created: 17/Apr/14 16:54
• Updated: 10/Feb/15 22:05
• Resolved: 10/Feb/15 22:05

Description

enable ubertask with linux container executer cause exception:

2014-04-17 23:26:07,859 DEBUG [localfetcher#1] org.apache.hadoop.mapreduce.task.reduce.LocalFetcher: LocalFetcher 1 going to fetch: attempt_1397748070416_0001_m_000006_0
2014-04-17 23:26:07,860 WARN [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: Exception running local (uberized) 'child' : org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in localfetcher#1
	at org.apache.hadoop.mapreduce.task.reduce.Shuffle.run(Shuffle.java:134)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:376)
	at org.apache.hadoop.mapred.LocalContainerLauncher$SubtaskRunner.runSubtask(LocalContainerLauncher.java:351)
	at org.apache.hadoop.mapred.LocalContainerLauncher$SubtaskRunner.run(LocalContainerLauncher.java:232)
	at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.ExceptionInInitializerError
	at org.apache.hadoop.mapred.SpillRecord.<init>(SpillRecord.java:70)
	at org.apache.hadoop.mapred.SpillRecord.<init>(SpillRecord.java:62)
	at org.apache.hadoop.mapred.SpillRecord.<init>(SpillRecord.java:57)
	at org.apache.hadoop.mapreduce.task.reduce.LocalFetcher.copyMapOutput(LocalFetcher.java:123)
	at org.apache.hadoop.mapreduce.task.reduce.LocalFetcher.doCopy(LocalFetcher.java:101)
	at org.apache.hadoop.mapreduce.task.reduce.LocalFetcher.run(LocalFetcher.java:84)
Caused by: java.lang.RuntimeException: Secure IO is not possible without native code extensions.
	at org.apache.hadoop.io.SecureIOUtils.<clinit>(SecureIOUtils.java:75)
	... 6 more

Issue Links

• duplicates: MAPREDUCE-5799 add default value of MR_AM_ADMIN_USER_ENV