Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1482

Better handling of task diagnostic information stored in the TaskInProgress

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Limit the size of diagnostics-string and state-string shipped as part of task status. This will help keep the JobTracker's memory usage under control. Diagnostic string and state string are capped to 1024 chars.

      Description

      Task diagnostic information can be very large at times eating up Jobtracker's memory. There should be some way to avoid storing large error strings in JobTracker.

        Attachments

        1. mapreduce-1482-v1.1.patch
          9 kB
          Amar Kamat
        2. mapreduce-1482-v1.2.patch
          9 kB
          Amar Kamat
        3. mapreduce-1482-v1.3.patch
          10 kB
          Amar Kamat
        4. mapreduce-1482-v1.7.patch
          10 kB
          Amar Kamat

          Activity

            People

            • Assignee:
              amar_kamat Amar Kamat
              Reporter:
              amar_kamat Amar Kamat
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: