[MAPREDUCE-138] Rework job-setup and job-cleanup tasks

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Assignee: Devaraj Das
• Reporter: Arun Murthy
• Created: 15/Oct/08 21:05
• Updated: 19/Jul/14 19:00
• Resolved: 19/Jul/14 19:00

Description

Currently we have a notion of map-

{setup|cleanup} TIP and reduce-{setup|cleanup}

TIP of which only 1 setup and cleanup tasks are picked by the JobInProgress. Also a lot of state-maintenence of these TIPs are done by the JobInProgress itself, outside of the more logical place i.e. TaskInProgress.

We really should rework this to have a single setup and cleanup task which isn't associated with a map or reduce task i.e. into separate task types. What we have currently is quite ungainly and hard to maintain.

Issue Links

• is blocked by: MAPREDUCE-29 JVM reuse across task types
• is related to: MAPREDUCE-251 Should we move out the creation of setup/cleanup tasks from JobInProgress.initTasks()?