Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3561 [Umbrella ticket] Performance issues in YARN+MR
  3. MAPREDUCE-3572

MR AM's dispatcher is blocked by heartbeats to ResourceManager

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mr-am, mrv2, performance
    • Labels:
      None

      Description

      All the heartbeat processing is done in RMContainerAllocator locking the object. The event processing is also locked on this, causing the dispatcher to be blocked and the rest of the AM getting stalled.

      The event processing should be in a separate thread.

        Attachments

        1. MAPREDUCE-3572-20111215.txt
          5 kB
          Vinod Kumar Vavilapalli
        2. MAPREDUCE-3572-20120104.txt
          9 kB
          Vinod Kumar Vavilapalli

          Activity

            People

            • Assignee:
              vinodkv Vinod Kumar Vavilapalli
              Reporter:
              vinodkv Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: