[TEZ-3611] Create lightweight summary events for ATS.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Hadoop Flags: Incompatible change
• Release Note: DAGPlan and Counters were moved out of TEZ_DAG_ID entity into DAG_EXTRA_INFO entity.
• Assignee: Harish JP
• Reporter: Harish JP
• Created: 07/Feb/17 17:11
• Updated: 22/Aug/17 00:02
• Resolved: 20/Apr/17 10:17

Description

All DAG*Event are summary logs. DAGSubmittedEvent has dagPlan in it and DAGFinishedEvent has counters in it. And hence these events very large, which makes the dag landing page on the tez-ui very expensive.

Split these events into two parts:

• One which contains only data used by the tez-ui "All Dags" page which will go into summary log.
• Another which will contain the current object, which will be part of the appropriate TimelineEntityGroupId.

Issue Links

• is related to: TEZ-3631 Tez UI: TEZ_DAG_EXTRA_INFO compatibility changes - Makes All DAGs page faster.