[HIVE-7076] Plugin (exec hook) to log to application timeline data to Yarn

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Assignee: Gunther Hagleitner
• Reporter: Gunther Hagleitner
• Created: 16/May/14 08:10
• Updated: 13/Nov/14 19:42
• Resolved: 18/Jun/14 22:47

Description

See: https://issues.apache.org/jira/browse/YARN-1530

This is a simple pre/post exec hook to log query + plan information to yarn. This information can be used to build tools and UIs to monitor, track, debug and tune Hive queries.

Off by default, but can be enabled via:

hive.exec.pre.hooks=ql.src.java.org.apache.hadoop.hive.ql.hooks.ATSHook

hive.exec.post.hooks=ql.src.java.org.apache.hadoop.hive.ql.hooks.ATSHook

hive.exec.failure.hooks=ql.src.java.org.apache.hadoop.hive.ql.hooks.ATSHook

Issue Links

• is related to: YARN-1530 [Umbrella] Store, manage and serve per-framework application-timeline data
• relates to: HIVE-7377 Configurable queue size for ATS Hook
• links to: review board