[OOZIE-1266] Oozie MapReduce failing to run

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: 3.3.1
• Component/s: examples
• Labels: hadoop023 mapreduce oozie
• Assignee: Unassigned
• Reporter: srikanth ayalasomayajulu
• Created: 14/Mar/13 02:38
• Updated: 25/Jan/18 21:03
• Resolved: 25/Jan/18 21:03

Description

Installed oozie 3.3.1 on apache hadoop 0.23.3, when trying to run an mapreduce example on the oozie, the following error is occurring.
2013-03-11 15:29:27,760 INFO ActionStartXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@:start:] Start action [0000000-130311152909237-oozie-srik-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2013-03-11 15:29:27,761 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@:start:] [***0000000-130311152909237-oozie-srik-W@:start:***]Action status=DONE
2013-03-11 15:29:27,762 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@:start:] [***0000000-130311152909237-oozie-srik-W@:start:***]Action updated in DB!
2013-03-11 15:29:28,106 INFO ActionStartXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] Start action [0000000-130311152909237-oozie-srik-W@mr-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2013-03-11 15:29:28,447 WARN MapReduceActionExecutor:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] credentials is null for the action
2013-03-11 15:29:31,521 INFO MapReduceActionExecutor:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] checking action, external ID [job_1362986780726_0001] status [RUNNING]
2013-03-11 15:29:31,524 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] [***0000000-130311152909237-oozie-srik-W@mr-node***]Action status=RUNNING
2013-03-11 15:29:31,524 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] [***0000000-130311152909237-oozie-srik-W@mr-node***]Action updated in DB!
2013-03-11 15:40:26,462 INFO MapReduceActionExecutor:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] action completed, external ID [job_1362986780726_0001]
2013-03-11 15:40:26,483 WARN MapReduceActionExecutor:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] LauncherMapper died, check Hadoop log for job [localhost:8040:job_1362986780726_0001]
2013-03-11 15:40:26,615 INFO ActionEndXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] ERROR is considered as FAILED for SLA
2013-03-11 15:40:26,669 INFO ActionStartXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@fail] Start action [0000000-130311152909237-oozie-srik-W@fail] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2013-03-11 15:40:26,670 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@fail] [***0000000-130311152909237-oozie-srik-W@fail***]Action status=DONE
2013-03-11 15:40:26,671 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@fail] [***0000000-130311152909237-oozie-srik-W@fail***]Action updated in DB!
2013-03-11 15:40:26,809 WARN CoordActionUpdateXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100

error logs :

2013-03-12 10:22:13,672 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://localhost:9000 /tmp/hadoop-yarn/staging/srikanth/.staging/job_1363053210358_0001
2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.yarn.service.CompositeService: Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter.stop(MRAppMaster.java:725)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1056)
at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.yarn.service.CompositeService: Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.getStat(RMContainerAllocator.java:530)
at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.stop(RMContainerAllocator.java:235)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.stop(MRAppMaster.java:673)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1056)
at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.ipc.Server: Stopping server on 51562
2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.ipc.Server: Stopping server on 51561