[YARN-6285] Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Assignee: yunjiong zhao
• Reporter: yunjiong zhao
• Created: 03/Mar/17 20:05
• Updated: 22/Mar/17 22:27

Description

When users called ApplicationClientProtocol.getApplications, it will return lots of data, and generate lots of garbage on ResourceManager which caused long time GC.
For example, on one of our RM, when called rest API " http://<rm http address:port>/ws/v1/cluster/apps" it can return 150MB data which have 944 applications.
getApplications have limit parameter, but some user might not set it, and then the limit will be Long.MAX_VALUE.

Issue Links

• is related to: YARN-6280 Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API
• relates to: YARN-6339 Improve performance for createAndGetApplicationReport