Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5262

Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      It is observed that RM triggers an one event for every ApplicationMaster#allocate request in the following trace. This is not necessarily required and it can be optimized such that send only if any containers are there to acknowledge to NodeManager.

      	RMAppAttemptImpl.sendFinishedContainersToNM() line: 1871	
      	RMAppAttemptImpl.pullJustFinishedContainers() line: 805	
      	ApplicationMasterService.allocate(AllocateRequest) line: 567
      

      Attachments

        1. 0002-YARN-5262.patch
          3 kB
          Rohith Sharma K S
        2. 0001-YARN-5262.patch
          3 kB
          Rohith Sharma K S

        Activity

          People

            rohithsharma Rohith Sharma K S
            rohithsharma Rohith Sharma K S
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: