[YARN-5883] Avoid or eliminate expensive YARN get all applications call

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: yarn-native-services
• Assignee: Gour Saha
• Reporter: Gour Saha
• Created: 15/Nov/16 06:59
• Updated: 06/Nov/17 22:32
• Resolved: 29/Nov/16 22:41

Description

YARN getAllApplications() call with no param or with application types getApplications(Set<String> applicationTypes) are very costly in a cluster with hundreds or thousands of Slider apps running.

YARN now has the API to filter by application tags - YARN-4491. We should be able to use this to avoid these expensive calls.