Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1100

User's task-logs filling up local disks on the TaskTrackers

    XMLWordPrintableJSON

Details

    Description

      Some user's jobs are filling up TT disks by outrageous logging. mapreduce.task.userlog.limit.kb is not enabled on the cluster. Disks are getting filled up before task-log cleanup via mapred.task.userlog.retain.hours can kick in.

      Attachments

        1. MAPREDUCE-1100-20091102.txt
          51 kB
          Vinod Kumar Vavilapalli
        2. MAPREDUCE-1100-20091106.txt
          79 kB
          Vinod Kumar Vavilapalli
        3. MAPREDUCE-1100-20091216.2.txt
          53 kB
          Arun Murthy
        4. patch-1100-fix-ydist.2.txt
          13 kB
          Vinod Kumar Vavilapalli
        5. reducetask-log-level.patch
          4 kB
          Todd Lipcon
        There are no Sub-Tasks for this issue.

        Activity

          People

            vinodkv Vinod Kumar Vavilapalli
            vinodkv Vinod Kumar Vavilapalli
            Votes:
            0 Vote for this issue
            Watchers:
            26 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: