[MAPREDUCE-927] Cleanup of task-logs should happen in TaskTracker instead of the Child - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.21.0
Fix Version/s: 0.22.0
Component/s: security, tasktracker
Labels:
None

Hadoop Flags:

Reviewed
Release Note:

Hide
Moved Task log cleanup into a separate thread in TaskTracker.
Added configuration "mapreduce.job.userlog.retain.hours" to specify the time(in hours) for which the user-logs are to be retained after the job completion.

Show
Moved Task log cleanup into a separate thread in TaskTracker. Added configuration "mapreduce.job.userlog.retain.hours" to specify the time(in hours) for which the user-logs are to be retained after the job completion.

Description

Task logs' cleanup is being done in Child now. This is undesirable atleast for two reasons: 1) failures while cleaning up will affect the user's tasks, and 2) the task's wall time will get affected due to operations that TT actually should own.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

patch-927.txt
19/Feb/10 04:30
31 kB
Amareshwari Sriramadasu
patch-927-1.txt
22/Feb/10 04:17
31 kB
Amareshwari Sriramadasu
patch-927-2.txt
03/Mar/10 06:20
43 kB
Amareshwari Sriramadasu
patch-927-3.txt
08/Mar/10 10:59
51 kB
Amareshwari Sriramadasu
patch-927-4.txt
09/Mar/10 06:27
50 kB
Amareshwari Sriramadasu
patch-927-5-dist.txt
17/Mar/10 05:51
152 kB
Vinod Kumar Vavilapalli

Issue Links

is blocked by

MAPREDUCE-1553 mapred.userlog.retain.hours is improperly renamed in MAPREDUCE-849

Resolved

Activity

People

Assignee:: Amareshwari Sriramadasu

Reporter:: Vinod Kumar Vavilapalli

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 28/Aug/09 10:37

Updated:: 19/Dec/10 03:33

Resolved:: 09/Mar/10 10:58