Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4584 Umbrella: Preemption and restart of MapReduce tasks
  3. MAPREDUCE-5867

Possible NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I configured KillAMPreemptionPolicy for My Application Master and tried to check preemption of queues.
      In one scenario I have seen below NPE in my AM

      014-04-24 15:11:08,860 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN CONTACTING RM.
      java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.rm.preemption.KillAMPreemptionPolicy.preempt(KillAMPreemptionPolicy.java:57)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.getResources(RMContainerAllocator.java:662)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:246)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:267)
      at java.lang.Thread.run(Thread.java:662)

      I was using 2.2.0 and merged MAPREDUCE-5189 to see how AM preemption works.

        Attachments

        1. Yarn-1980.1.patch
          1 kB
          Sunil Govindan
        2. MapReduce-5867-updated.patch
          9 kB
          Sunil Govindan
        3. MapReduce-5867-updated.patch
          9 kB
          Devaraj K
        4. MapReduce-5867.3.patch
          13 kB
          Sunil Govindan
        5. MapReduce-5867.2.patch
          2 kB
          Sunil Govindan

          Activity

            People

            • Assignee:
              sunilg Sunil Govindan
              Reporter:
              sunilg Sunil Govindan
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: