[YARN-10144] Federation: Add missing FederationClientInterceptor APIs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: federation, router
• Labels: pull-request-available
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Assignee: Shilun Fan
• Reporter: D M Murali Krishna Reddy
• Created: 18/Feb/20 06:41
• Updated: 23/Jan/24 01:58
• Resolved: 03/May/23 16:22

Description

In FederationClientInterceptor, many API's are not Implemented.

• getClusterNodes
• getQueueInfo
• getQueueUserAcls
• moveApplicationAcrossQueues
• getNewReservation
• submitReservation
• listReservations
• updateReservation
• deleteReservation
• getNodeToLabels
• getLabelsToNodes
• getClusterNodeLabels
• getApplicationAttemptReport
• getApplicationAttempts
• getContainerReport
• getContainers
• getDelegationToken
• renewDelegationToken
• cancelDelegationToken
• failApplicationAttempt
• updateApplicationPriority
• signalToContainer
• updateApplicationTimeouts
• getResourceProfiles
• getResourceProfile
• getResourceTypeInfo
• getAttributesToNodes
• getClusterNodeAttributes
• getNodesToAttributes

Issue Links

• is related to: YARN-6740 Federation Router (hiding multiple RMs for ApplicationClientProtocol) phase 2
• links to: GitHub Pull Request #5587

Sub-Tasks

• Support signalToContainer API for Federation: Resolved
• For Federation,yarn applicationattempt fail command throws an exception: Resolved
• In Federation executing yarn queue status command throws an exception: Resolved
• In Federation cluster Distributed Shell Application submission fails as YarnClient#getQueueInfo is not implemented: Resolved
• For Federation, we should support getApplicationAttemptReport.: Resolved
• Support getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation: Resolved
• Support getQueueUserAcls, listReservations, getApplicationAttempts, getContainerReport, getContainers, getResourceTypeInfo API's for Federation: Resolved
• Support getApplications API in FederationClientInterceptor: Resolved
• Add metrics for getClusterMetrics and getApplications APIs in FederationClientInterceptor: Resolved
• Use invokeConcurrent Overload with Collection in getClusterMetrics: Resolved
• Check GetClusterMetrics Request parameter is null: Resolved
• Support getClusterNodes API in FederationClientInterceptor: Resolved
• RouterClientRMService Has Unused import: Resolved
• Support getNodeToLabels API in FederationClientInterceptor: Resolved
• Support getLabelsToNodes API in FederationClientInterceptor: Resolved
• Improve log message in FederationClientInterceptor: Resolved
• TestRouterWebServicesREST Junit Test Error Fix: Resolved
• Support getClusterNodeLabels API in FederationClientInterceptor: Resolved
• Support getDelegationToken, renewDelegationToken, cancelDelegationToken API's for Federation: Resolved
• Support failApplicationAttempt, updateApplicationPriority, updateApplicationTimeouts API's for Federation: Resolved
• Support getResourceProfiles, getResourceProfile API's for Federation: Resolved
• Support getAttributesToNodes, getClusterNodeAttributes, getNodesToAttributes API's for Federation: Resolved
• Support moveApplicationAcrossQueues, getQueueInfo API's for Federation: Resolved
• Support getNewReservation, submitReservation, updateReservation, deleteReservation API's for Federation: Resolved
• Refactor some code of getNewApplication, submitApplication, forceKillApplication, getApplicationReport: Resolved
• Fix typo in hadoop-yarn-server-router module: Resolved
• Optimizing FederationClientInterceptor Call with Parallelism: Resolved
• Optimize FederationClientInterceptor audit log: Resolved
• Improve Yarn Router Reservation Submission Code: Resolved
• [Federation] Refactor FederationClientInterceptor#submitApplication Use FederationActionRetry: Resolved