[TEZ-2319] DAG history in HDFS - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Major
Resolution: Duplicate
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Description

We have processes, that parse jobconf.xml and job history details (map and reduce task details, etc) in avro files from HDFS and load them into hive tables for analysis for mapreduce jobs. Would like to have Tez also make this information written to a history file in HDFS when AM or each DAG completes so that we can do analytics on Tez jobs.

Attachments

Issue Links

duplicates

TEZ-2628 History logging plugin to write ATS events to HDFS

Open

Activity

People

Assignee:: Unassigned

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Created:: 14/Apr/15 16:41

Updated:: 16/Sep/16 19:03

Resolved:: 16/Sep/16 19:03