[YARN-3368] [Umbrella] YARN web UI: Next generation

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Jian He
• Created: 18/Mar/15 23:14
• Updated: 08/Feb/18 04:22

Description

The goal is to improve YARN UI for better usability.

We may take advantage of some existing front-end frameworks to build a fancier, easier-to-use UI.

The old UI continue to exist until we feel it's ready to flip to the new UI.
This serves as an umbrella jira to track the tasks. we can do this in a branch.

Issue Links

• depends upon: YARN-4417 Make RM and Timeline-server REST APIs more consistent
• is depended upon by: YARN-4097 Create POC timeline web UI with new YARN web UI framework
• is related to: YARN-7169 Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)
• relates to: YARN-2031 YARN Proxy model doesn't support REST APIs in AMs

Sub-Tasks

• [YARN-3368] Upgrade to Ember 2.2.0: Resolved
• [YARN-3368] Cleanup hardcoded configurations, such as RM/ATS addresses: Resolved
• [YARN-3368] Support hosting web UI framework inside YARN RM: Resolved
• [YARN-3368] Use em-table to better render tables: Resolved
• [YARN-3368] Add nodes page: Resolved
• [YARN-3368] Support rendering statistic-by-node-label for queues/apps page: Patch Available
• [YARN-3368] Initial commit of new YARN web UI: Resolved
• Merge branch:YARN-3368 to trunk: Resolved
• [YARN-3368] REST API related changes for new Web UI: Patch Available
• [YARN-3368] Add AM related pages: Open
• [YARN-3368] Unify app/container pages and other miscellaneous issues: Open
• [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.: Resolved
• [YARN-3368] Cleanup source code including license/build-script of YARN web UI framework: Resolved
• [YARN-3368] Support pagination for RM/ATS Web UI applications page.: Open
• [YARN-3368] Fix licensing issues in new Yarn-ui: Resolved
• [YARN-3368] App attempt page is not loading when timeline server is not started: Resolved
• [YARN-3368] Change urls in new YARN ui from camel casing to hyphens: Resolved
• [YARN-3368] Application and Container pages shows wrong values when RM is stopped: Resolved
• [YARN-3368] Make new YARN UI work under secure cluster: Open
• [YARN-3368] Make new YARN UI work under HA cluster: Open
• [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR: Resolved
• Support for Fair Scheduler in new YARN UI: Resolved
• [YARN-3368] Showing JMX metrics for YARN servers on new YARN UI: Open
• [UI2] Add page to new YARN UI to view server side configurations/logs/JVM-metrics: Resolved
• [YARN-3368] Supports application table pagination in scheduler's page.: Open
• [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI: Patch Available
• [UI2] Support kill application from new YARN UI: Resolved
• [YARN-3368] Avoid reloading web page after selecting different queues in scheduler page: Patch Available
• Add a toggle button to switch between timeline view / table view for containers and application-attempts in new YARN UI: Resolved
• [YARN-3368] Show pending resource requests on application-attempt page: Open
• [YARN-3368] Update doc for YARN-UI: Open
• [YARN-3368] Add Apache Hadoop logo in YarnUI home page: Resolved
• [YARN-3368] Support for responsive navbar when window is resized: Resolved
• [YARN-3368] Add nodes heatmap chart: Resolved
• [YARN-3368] Introduce footer in YARN UI: Open
• [YARN-3368] Add resource usage by applications and queues to cluster overview page.: Resolved
• [YARN-3368] Add resource usage for application by node managers: Resolved
• [YARN-3368] Add a node heat chart map: Resolved
• [YARN-3368] Introduce REFRESH button in various UI pages: Resolved
• Use em-table in app/nodes pages for new YARN UI: Resolved
• [YARN-3368] Generic UI improvements: Resolved
• [YARN-3368] Cluster overview page improvements: Resolved
• [YARN-3368] Queues page improvements: Resolved
• [YARN-3368] Applications page improvements: Resolved
• [YARN-3368] Node details page improvements: Resolved
• Fix NoSuchMethodError in ClusterMetricsInfo: Resolved
• Cluster Resource Usage table is not displayed when user clicks on hadoop logo on top of web UI home page: Resolved
• Applications table overflows beyond the page boundary: Resolved
• [YARN-3368] Fix various alignment issues and broken breadcrumb link in Node page: Resolved
• In leaf queue page, list applications should only show applications from that leaf queues: Resolved
• Nodes page throws "Sorry Error Occurred" message: Resolved
• [YARN-3368] Support scheduler activities in new YARN UI: Open
• Improvement on doughnut subcharts: Open
• Make Node Heatmap Chart categories clickable in new YARN UI: Resolved
• Use different color for Undefined and Succeeded for Final State in applications page: Resolved
• [Usability] Make UI continue to work and render already loaded models even when there is no network connection: Open
• [YARN-3368] Add missing hidden files in webapp folder for deployment: Resolved
• [YARN-3368] Fix YARN UI build pom.xml: Resolved
• 'Master node' link under application tab is broken: Resolved
• Build error due to preparing 3.0.0-alpha2 deployment: Resolved
• Finished containers for running application should be displayed on container table: Resolved
• Fix jshint to use es6: Open
• [YARN-3368] Fix wrong paths in .gitignore: Resolved
• [YARN-3368] Fix create-release to be able to generate bits for the new yarn-ui: Resolved
• [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder: Resolved
• [YARN-3368] Launch new YARN UI under hadoop web app port: Resolved
• Show timeline data from ATS v2 in new web UI: Resolved
• [YARN-3368] Update UI2 documentation for new UI2 path: Resolved
• Replace old Hadoop logo with new one: Resolved
• [YARN-3368] Document limits/notes of the new YARN UI: Resolved
• Ability to Auto Refresh Cluster Overview page, Application page.: In Progress
• [YARN-3368] Accessing applications and containers list from Node page is throwing few exceptions in console: Resolved
• New UI2 is not able to launch with jetty 9 upgrade post HADOOP-10075: Resolved
• Fix few issues reported by jshint in new YARN UI: Resolved
• Fix breadcrumb issues for various pages in new YARN UI: Resolved
• [UI2] Improve unit tests for new YARN UI: Resolved
• Make navigation link active when selecting sub tabs in "Applications" and "Nodes" page for new UI: Resolved
• Fix alignment issues and missing information in new YARN UI's Queue page: Resolved
• Few missing informations in Application and Application Attempt pages for new YARN UI.: Resolved
• Introduce loading icon in each page of new YARN UI: Resolved
• Improve Resource Donut chart with better label in Node page of new YARN UI: Resolved
• localBaseAddress for CORS proxy configuration is not working when suffixed with forward slash in new YARN UI.: Resolved
• Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation in new YARN UI: Resolved
• Investigate Java 7 compatibility for new YARN UI: Open
• Use frontend-maven-plugin 0.0.22 version for new yarn ui: Resolved
• [YARN-3368] Refactor of yarn-node related pages in YARN-UI: Open
• [YARN-3368] Improvements in cluster-overview page in YARN-UI: Patch Available
• Move 'Long Running Services' to an independent tab at top level for new Yarn UI: Resolved
• Show decommissioning nodes in new YARN UI: Resolved
• Use deployed webapp folder to launch new YARN UI: Resolved
• Refactor loader.js in new Yarn UI: Resolved
• Refactor yarn-app pages in new YARN UI.: Resolved
• Flow Activity should specify 'metricstoretrieve' in its query to ATSv2 to retrieve CPU and memory: Open
• Merge flow info and flow runs: Open
• Retrieve CPU and MEMORY metrics for applications in a flow run: Open
• New web UI query history applications from ATSv2: Open
• Display containers of applications returned from ATSv2: Resolved
• [YARN-3368] Be able to view application / container logs on the new YARN UI.: Resolved
• [YARN-3368] Highlight items on hover in Cluster Overview: Open
• Better styling for donut charts in new YARN UI: Resolved
• Render application specific log under application tab in new YARN UI: Resolved
• Improve Nodes Heatmap in new YARN UI with better color coding: Resolved
• Refactor of Queue Visualization: In Progress
• Fix Missing Memory and CPU Metric in WebUI v2 Flow Activity Tab: Resolved
• Add vcores and number of containers in new YARN UI node heat map: Resolved
• [YARN-3368] CSS changes in new YARN-UI: Resolved
• Support same origin policy for cross site scripting prevention.: Resolved
• Render cluster information on new YARN web ui: Resolved
• Render tooltips on columns where text is clipped in new YARN UI: Resolved
• Allow node partition filters on Queues page of new YARN UI: Resolved
• Allow searchable filter for Application page log viewer in new YARN UI: Resolved
• Application page UI is broken in app error state: Resolved