[YARN-5739] Provide timeline reader API to list available timeline entity types for one application

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, YARN-5355, 3.0.0-beta1
• Component/s: timelinereader
• Hadoop Flags: Reviewed
• Assignee: Li Lu
• Reporter: Li Lu
• Created: 14/Oct/16 22:36
• Updated: 21/Oct/17 06:05
• Resolved: 08/Dec/16 19:28

Description

Right now we only show a part of available timeline entity data in the new YARN UI. However, some data (especially library specific data) are not possible to be queried out by the web UI. It will be appealing for the UI to provide an "entity browser" for each YARN application. Actually, simply dumping out available timeline entities (with proper pagination, of course) would be pretty helpful for UI users.

On timeline side, we're not far away from this goal. Right now I believe the only thing missing is to list all available entity types within one application. The challenge here is that we're not storing this data for each application, but given this kind of call is relatively rare (compare to writes and updates) we can perform some scanning during the read time.

Issue Links

• is depended upon by: YARN-5925 Extract hbase-backend-exclusive utility methods from TimelineStorageUtil