Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5262

Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      It is observed that RM triggers an one event for every ApplicationMaster#allocate request in the following trace. This is not necessarily required and it can be optimized such that send only if any containers are there to acknowledge to NodeManager.

      	RMAppAttemptImpl.sendFinishedContainersToNM() line: 1871	
      	RMAppAttemptImpl.pullJustFinishedContainers() line: 805	
      	ApplicationMasterService.allocate(AllocateRequest) line: 567
      

      Attachments

        1. 0001-YARN-5262.patch
          3 kB
          Rohith Sharma K S
        2. 0002-YARN-5262.patch
          3 kB
          Rohith Sharma K S

        Issue Links

          Activity

            People

              rohithsharma Rohith Sharma K S
              rohithsharma Rohith Sharma K S
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: