[YARN-220] NM should limit number of applications who's logs are being aggregated

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.23.4
• Component/s: nodemanager
• Assignee: Unassigned
• Reporter: Robert Joseph Evans
• Created: 16/Nov/12 18:40
• Updated: 26/Feb/20 05:29

Description

The NodeManager should limit the number of applications that have their logs being aggregated in parallel. This will reduce the load on the NN. We need to ensure that the RM will continue to renew the token while this is happening. We also should look if the NM starts to fall behind if it can delete some of the logs or not.