[MAPREDUCE-700] Too many copies of job-conf with the jobtracker

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: jobtracker
• Assignee: Amar Kamat
• Reporter: Amar Kamat
• Created: 03/Jul/09 04:20
• Updated: 22/Jul/14 18:50
• Resolved: 22/Jul/14 18:50

Description

As of today the jobtracker has job-conf copies in

1. mapred.system.dir : created while job-submission
2. jobtracker-subdir (created by JobInProgress upon creation)
3. log-dir : created upon job-init
4. history-dir : created upon job-init

Its difficult to manage these conf files. The problem aggravates under restart.

Issue Links

• is blocked by: MAPREDUCE-173 JobConf should also load resources from hdfs (or other filesystems)