[YARN-3299] Synchronize RM and Generic History Service Web-UIs

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: resourcemanager, webapp, yarn
• Assignee: Xuan Gong
• Reporter: Xuan Gong
• Created: 06/Mar/15 05:37
• Updated: 21/Jul/15 22:25
• Resolved: 21/Jul/15 22:25

Description

After YARN-1809, we are using the same protocol to fetch the information and display in their webUI. RM webUI will use ApplicationClientProtocol, and Generic History Service web ui will use ApplicationHistoryProtocol. Both of them extend the same protocol.
Also, we have common appblock/attemptblock/containerblock shared by both RM webUI and ATS webUI.

But we are still missing some information, such as outstanding resource requests, preemption metrics, etc.

This ticket will be used as parent ticket to track all the remaining issues for RM webUI and ATS webUI.

Sub-Tasks

• ContainerReport should have nodeHttpAddress: Closed
• Expose more ApplicationMetrics and ApplicationAttemptMetrics through YARN command: Open
• Synchronize RM and Generic History Service Web-UIs: Closed
• outstanding_resource_requests table should not be shown in AHS: Closed
• Fix the format issue of the new RM web UI and AHS web UI after YARN-3272 / YARN-3262: Closed
• Sort by Application id, AppAttempt & ContainerID doesn't work in ATS / RM web ui: Closed
• Few issues in ApplicationHistory web ui: Resolved
• Missing data in localityTable and ResourceRequests table in RM WebUI: Closed
• RMAppAttempt headroom data is missing in RM Web UI: Closed
• AHS API and other AHS changes to handle tags for completed MR jobs: Resolved
• AM logs link missing in the RM UI for a completed app: Closed
• ATS Web Performance issue at load time when large number of jobs: Closed
• Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS: Closed
• ATS Web UI breaks because of YARN-3467: Resolved
• loading applications by filtering appstartedTime period for ATS Web UI: Resolved
• ApplicationReport should be able to tell whether the Application is AM managed or not.: Resolved