[MAPREDUCE-721] When "mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files are not getting deleted after that x hours.It gets deleted after some random hours which is greater than x hours.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: documentation
• Labels: newbie
• Assignee: Unassigned
• Reporter: Iyappan Srinivasan
• Created: 07/Jul/09 07:51
• Updated: 23/Jul/14 18:54

Description

When "mapred.job.tracker.persist.jobstatus.hours" is set to 1 hour, the jobid files, present in configured directory, are not getting deleted after that 1 hour. It gets deleted after some random hours.

This is irrespective of whether "mapred.job.tracker.persist.jobstatus.dir" is set to local file system or DFS.

Steps to reproduce the issue:

1) Im mapred-site.xml,

Set "mapred.job.tracker.persist.jobstatus.active" to "true"
Set "mapred.job.tracker.persist.jobstatus.hours" to "1"
Set "mapred.job.tracker.persist.jobstatus.dir" to either a local file syste by preixing it with file:/// or dfs by giving a dfs directory without the "file:///"

2) After that run any job.
3) After it is complete the job id file comes in the configured directory.
4) Wait for one hour
5) Observe After 1 hour the files are not deleted.
6) After some random hours, files gets deleted.