Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1266

Oozie MapReduce failing to run

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: 3.3.1
    • Fix Version/s: None
    • Component/s: examples

      Description

      Installed oozie 3.3.1 on apache hadoop 0.23.3, when trying to run an mapreduce example on the oozie, the following error is occurring.
      2013-03-11 15:29:27,760 INFO ActionStartXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@:start:] Start action [0000000-130311152909237-oozie-srik-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
      2013-03-11 15:29:27,761 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@:start:] [***0000000-130311152909237-oozie-srik-W@:start:***]Action status=DONE
      2013-03-11 15:29:27,762 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@:start:] [***0000000-130311152909237-oozie-srik-W@:start:***]Action updated in DB!
      2013-03-11 15:29:28,106 INFO ActionStartXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] Start action [0000000-130311152909237-oozie-srik-W@mr-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
      2013-03-11 15:29:28,447 WARN MapReduceActionExecutor:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] credentials is null for the action
      2013-03-11 15:29:31,521 INFO MapReduceActionExecutor:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] checking action, external ID [job_1362986780726_0001] status [RUNNING]
      2013-03-11 15:29:31,524 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] [***0000000-130311152909237-oozie-srik-W@mr-node***]Action status=RUNNING
      2013-03-11 15:29:31,524 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] [***0000000-130311152909237-oozie-srik-W@mr-node***]Action updated in DB!
      2013-03-11 15:40:26,462 INFO MapReduceActionExecutor:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] action completed, external ID [job_1362986780726_0001]
      2013-03-11 15:40:26,483 WARN MapReduceActionExecutor:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] LauncherMapper died, check Hadoop log for job [localhost:8040:job_1362986780726_0001]
      2013-03-11 15:40:26,615 INFO ActionEndXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@mr-node] ERROR is considered as FAILED for SLA
      2013-03-11 15:40:26,669 INFO ActionStartXCommand:539 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@fail] Start action [0000000-130311152909237-oozie-srik-W@fail] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
      2013-03-11 15:40:26,670 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@fail] [***0000000-130311152909237-oozie-srik-W@fail***]Action status=DONE
      2013-03-11 15:40:26,671 WARN ActionStartXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[0000000-130311152909237-oozie-srik-W@fail] [***0000000-130311152909237-oozie-srik-W@fail***]Action updated in DB!
      2013-03-11 15:40:26,809 WARN CoordActionUpdateXCommand:542 - USER[srikanth] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-130311152909237-oozie-srik-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100

      error logs :

      2013-03-12 10:22:13,672 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://localhost:9000 /tmp/hadoop-yarn/staging/srikanth/.staging/job_1363053210358_0001
      2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.yarn.service.CompositeService: Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
      java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter.stop(MRAppMaster.java:725)
      at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
      at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1056)
      at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
      2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.yarn.service.CompositeService: Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
      java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.getStat(RMContainerAllocator.java:530)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.stop(RMContainerAllocator.java:235)
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.stop(MRAppMaster.java:673)
      at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
      at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$MRAppMasterShutdownHook.run(MRAppMaster.java:1056)
      at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
      2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.ipc.Server: Stopping server on 51562
      2013-03-12 10:22:13,687 INFO [Thread-1] org.apache.hadoop.ipc.Server: Stopping server on 51561

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              srikraj8341 srikanth ayalasomayajulu
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified