[MAPREDUCE-215] Improve facilities for job-control, job-queues etc.

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Arun Murthy
• Created: 21/Dec/07 21:20
• Updated: 17/Jul/14 19:19
• Resolved: 17/Jul/14 19:19

Description

Today, Map-Reduce has some support for job-control - basically JobClient provides a facility to monitor jobs, one can setup a job-ending notification and there is JobControl.

Links:
http://lucene.apache.org/hadoop/docs/r0.15.1/mapred_tutorial.html#Job+Control
http://lucene.apache.org/hadoop/docs/r0.15.1/mapred_tutorial.html#JobControl

Looks like users could do more with better facilities for job-control and maybe more advanced features like job-queues etc.

Lets discuss...

Issue Links

• relates to: PIG-195 Pig should you Hadoop's jobcontrol mechanism to submit/monitor Map-Reduce jobs