Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7137

MRAppBenchmark.benchmark1() fails with NullPointerException

    Details

    • Hadoop Flags:
      Reviewed

      Description

      MRAppBenchmark.benchmark1() fails with NullPointerException:
      1. We do not set any queue for this test. As the result we got the following exception:

      2018-09-10 17:04:23,486 ERROR [Thread-0] rm.RMCommunicator (RMCommunicator.java:register(177)) - Exception while registering
      java.lang.NullPointerException
      at org.apache.avro.util.Utf8$2.toUtf8(Utf8.java:123)
      at org.apache.avro.util.Utf8.getBytesFor(Utf8.java:172)
      at org.apache.avro.util.Utf8.<init>(Utf8.java:39)
      at org.apache.hadoop.mapreduce.jobhistory.JobQueueChangeEvent.<init>(JobQueueChangeEvent.java:35)
      at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.setQueueName(JobImpl.java:1167)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.register(RMCommunicator.java:174)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStart(RMCommunicator.java:122)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStart(RMContainerAllocator.java:280)
      at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
      at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
      at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1293)
      at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
      at org.apache.hadoop.mapreduce.v2.app.MRApp.submit(MRApp.java:301)
      at org.apache.hadoop.mapreduce.v2.app.MRApp.submit(MRApp.java:285)
      at org.apache.hadoop.mapreduce.v2.app.MRAppBenchmark.run(MRAppBenchmark.java:72)
      at org.apache.hadoop.mapreduce.v2.app.MRAppBenchmark.benchmark1(MRAppBenchmark.java:194)
      
      

      2. We override createSchedulerProxy method and do not set application priority that was added later by MAPREDUCE-6515. We got the following error:

      java.lang.NullPointerException
       at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.handleJobPriorityChange(RMContainerAllocator.java:1025)
       at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.getResources(RMContainerAllocator.java:880)
       at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:286)
       at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$AllocatorRunnable.run(RMCommunicator.java:280)
       at java.lang.Thread.run(Thread.java:748)
      

      In both cases, the job never will be run and the test stuck and will not be finished.

        Attachments

        1. MAPREDUCE-7137.001.patch
          2 kB
          Oleksandr Shevchenko

          Issue Links

            Activity

              People

              • Assignee:
                oshevchenko Oleksandr Shevchenko
                Reporter:
                oshevchenko Oleksandr Shevchenko
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: