Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1482

Better handling of task diagnostic information stored in the TaskInProgress

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • jobtracker
    • None
    • Reviewed
    • Limit the size of diagnostics-string and state-string shipped as part of task status. This will help keep the JobTracker's memory usage under control. Diagnostic string and state string are capped to 1024 chars.

    Description

      Task diagnostic information can be very large at times eating up Jobtracker's memory. There should be some way to avoid storing large error strings in JobTracker.

      Attachments

        1. mapreduce-1482-v1.7.patch
          10 kB
          Amar Kamat
        2. mapreduce-1482-v1.3.patch
          10 kB
          Amar Kamat
        3. mapreduce-1482-v1.2.patch
          9 kB
          Amar Kamat
        4. mapreduce-1482-v1.1.patch
          9 kB
          Amar Kamat

        Activity

          People

            amar_kamat Amar Kamat
            amar_kamat Amar Kamat
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: