[MAPREDUCE-3975] Default value not set for Configuration parameter mapreduce.job.local.dir

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.1, 0.23.2
• Fix Version/s: 0.23.2
• Component/s: mrv2
• Target Version/s: 0.23.2
• Hadoop Flags: Reviewed
• Release Note: Exporting mapreduce.job.local.dir for mapreduce tasks to use as job-level shared scratch space.
• Assignee: Eric Payne
• Reporter: Eric Payne
• Created: 05/Mar/12 23:17
• Updated: 08/Mar/12 19:46
• Resolved: 08/Mar/12 19:38

Description

mapreduce.job.local.dir (formerly job.local.dir in 0.20) is not set by default. This is a regression from 0.20.205.

In 0.20.205, JobLocalizer.createWorkDir() constructs the "$mapred.local.dir/taskTracker/$user/jobcache/$jobid/work" path based on $user and $jobid, and then sets TaskTracker.JOB_LOCAL_DIR in the job's JobConf.

So far, I haven't found where this is done in 0.23. It could be that this is what should be done by LocalJobRunner.setupChildMapredLocalDirs(), but I am still investigating.