[MAPREDUCE-2918] Provide programmatic access to use job log

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: mrv2
• Assignee: Unassigned
• Reporter: Mohammad Islam
• Created: 30/Aug/11 07:53
• Updated: 04/Oct/11 21:56

Description

Since hadoop job/task log is critical for debugging, providing a programmatic access would definitely add a big value to the end user.

Oozie users are repeatedly asking to open up the hadoop job log for them. However, Oozie doesn't have any knowledge about the log location as well as the log contents of hadoop job.

The expected programmatic access could come in any or both ways:
1. Allowing an API such as getLogPath(jobId) that returns the base HDFS path of the job directory.
2. Allowing an API such as getLog(jobId) that will return the log contents (may be as streaming output).