Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4584 Umbrella: Preemption and restart of MapReduce tasks
  3. MAPREDUCE-5867

Possible NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 3.0.0-alpha1
    • resourcemanager
    • None
    • Reviewed

    Description

      I configured KillAMPreemptionPolicy for My Application Master and tried to check preemption of queues.
      In one scenario I have seen below NPE in my AM

      014-04-24 15:11:08,860 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN CONTACTING RM.
      java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.rm.preemption.KillAMPreemptionPolicy.preempt(KillAMPreemptionPolicy.java:57)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.getResources(RMContainerAllocator.java:662)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:246)
      at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:267)
      at java.lang.Thread.run(Thread.java:662)

      I was using 2.2.0 and merged MAPREDUCE-5189 to see how AM preemption works.

      Attachments

        1. Yarn-1980.1.patch
          1 kB
          Sunil G
        2. MapReduce-5867.2.patch
          2 kB
          Sunil G
        3. MapReduce-5867.3.patch
          13 kB
          Sunil G
        4. MapReduce-5867-updated.patch
          9 kB
          Sunil G
        5. MapReduce-5867-updated.patch
          9 kB
          Devaraj Kavali

        Activity

          People

            sunilg Sunil G
            sunilg Sunil G
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: