[YARN-6280] Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Component/s: resourcemanager, restapi
• Hadoop Flags: Reviewed
• Assignee: Lantao Jin
• Reporter: Lantao Jin
• Created: 03/Mar/17 13:01
• Updated: 17/Jul/17 06:57
• Resolved: 17/Jul/17 06:57

Description

Begin from v2.7, the ResourceManager Cluster Applications REST API returns ResourceRequest list. It's a very large construction in AppInfo.
As a test, we use below URI to query only 2 results:
http://<rm http address:port>/ws/v1/cluster/apps?states=running,accepted&limit=2
The results are very different:

Hadoop version	Total Character	Total Word	Total Lines	Size
2.4.1	1192	42	42	1.2 KB
2.7.1	1222179	48740	48735	1.21 MB

Most RESTful API requesters don't know about this after upgraded and their old queries may cause ResourceManager more GC consuming and slower. Even if they know this but have no idea to reduce the impact of ResourceManager except slow down their query frequency.

The patch adding a query parameter "showResourceRequests" to help requesters who don't need this information to reduce the overhead. In consideration of compatibility of interface, the default value is true if they don't set the parameter, so the behaviour is the same as now.

Issue Links

• relates to: YARN-6285 Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications