Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1100

User's task-logs filling up local disks on the TaskTrackers

    Details

      Description

      Some user's jobs are filling up TT disks by outrageous logging. mapreduce.task.userlog.limit.kb is not enabled on the cluster. Disks are getting filled up before task-log cleanup via mapred.task.userlog.retain.hours can kick in.

        Attachments

        1. reducetask-log-level.patch
          4 kB
          Todd Lipcon
        2. patch-1100-fix-ydist.2.txt
          13 kB
          Vinod Kumar Vavilapalli
        3. MAPREDUCE-1100-20091216.2.txt
          53 kB
          Arun C Murthy
        4. MAPREDUCE-1100-20091106.txt
          79 kB
          Vinod Kumar Vavilapalli
        5. MAPREDUCE-1100-20091102.txt
          51 kB
          Vinod Kumar Vavilapalli

          Activity

            People

            • Assignee:
              vinodkv Vinod Kumar Vavilapalli
              Reporter:
              vinodkv Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              26 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: