Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2657 TaskTracker should handle disk failures
  3. MAPREDUCE-3011

TT should remove bad local dirs from conf to prevent constant disk checking

          Details

          • Type: Sub-task
          • Status: Closed
          • Priority: Major
          • Resolution: Not A Problem
          • Affects Version/s: 0.20.204.0
          • Fix Version/s: None
          • Component/s: tasktracker
          • Labels:
            None

            Description

            Per HADOOP-7551 the TT does not remove bad mapred.local.dirs from the conf so after a single disk failure every call to get a local path for reading or writing results in a disk check of all configured local dirs. After detecting that a local dir is bad we should remove it from the conf so that we don't repeatedly perform this expensive operation.

              Attachments

                Issue Links

                relates to

                Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-3077 re-enable faulty TaskTracker storage without restarting TT, when appropriate

                • Major - Major loss of function.
                • Open

                  Activity

                    People

                    • Assignee:
                      eli Eli Collins
                      Reporter:
                      eli Eli Collins
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      3 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: