Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Fixed
-
0.20.204.0
-
None
-
Reviewed
Description
Currently, userlogs directory in TaskTracker is placed under hadoop.log.dir like <hadoop.log.dir>/userlogs. I am proposing to spread these userlogs onto multiple configured mapred.local.dirs to strengthen TaskTracker reliability w.r.t disk failures.
Attachments
Attachments
Issue Links
- breaks
-
MAPREDUCE-2920 Local log dir links in the JT web UI are broken
- Closed
- is blocked by
-
MAPREDUCE-2413 TaskTracker should handle disk failures at both startup and runtime
- Closed
- is related to
-
MAPREDUCE-2851 Add test for userlogs on multiple disks (MR-2415)
- Open
-
MAPREDUCE-2846 a small % of all tasks fail with DefaultTaskController
- Closed
- relates to
-
MAPREDUCE-2804 "Creation of symlink to attempt log dir failed." message is not useful
- Closed
-
MAPREDUCE-4481 User Log Retention across TT restarts
- Reopened