Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1482

Better handling of task diagnostic information stored in the TaskInProgress

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Limit the size of diagnostics-string and state-string shipped as part of task status. This will help keep the JobTracker's memory usage under control. Diagnostic string and state string are capped to 1024 chars.

      Description

      Task diagnostic information can be very large at times eating up Jobtracker's memory. There should be some way to avoid storing large error strings in JobTracker.

      1. mapreduce-1482-v1.1.patch
        9 kB
        Amar Kamat
      2. mapreduce-1482-v1.2.patch
        9 kB
        Amar Kamat
      3. mapreduce-1482-v1.3.patch
        10 kB
        Amar Kamat
      4. mapreduce-1482-v1.7.patch
        10 kB
        Amar Kamat

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Amar Kamat
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development