[TEZ-3351] Handle ATS performance issues for Hive-LLAP.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Harish JP
• Reporter: Harish JP
• Created: 14/Jul/16 23:13
• Updated: 19/Jul/16 12:33

Description

With Hive-LLAP, we have subsecond queries and hence can run lots of queries in a small interval. This can overload ATS with lot of events and create large number of file hdfs. This jira is to reduce performance impact of ATS logging by Tez.

Sub-Tasks

• Change TimelineCachePlugin to handle DAG grouping: Closed
• Support using the same TimelineGroupId for multiple DAGs: Closed
• Add granular log levels for HistoryLoggingService.: Closed
• TezClient test case for history logging.: Open
• Change TEZ_HISTORY_LOGGING_TIMELINE_NUM_DAGS_PER_GROUP conf key name.: Closed
• Fix groupId generation to account for dagId starting with 1.: Closed