Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3561 [Umbrella ticket] Performance issues in YARN+MR
  3. MAPREDUCE-3572

MR AM's dispatcher is blocked by heartbeats to ResourceManager

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mr-am, mrv2, performance
    • None

    Description

      All the heartbeat processing is done in RMContainerAllocator locking the object. The event processing is also locked on this, causing the dispatcher to be blocked and the rest of the AM getting stalled.

      The event processing should be in a separate thread.

      Attachments

        1. MAPREDUCE-3572-20111215.txt
          5 kB
          Vinod Kumar Vavilapalli
        2. MAPREDUCE-3572-20120104.txt
          9 kB
          Vinod Kumar Vavilapalli

        Activity

          People

            vinodkv Vinod Kumar Vavilapalli
            vinodkv Vinod Kumar Vavilapalli
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: