Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-430

Task stuck in cleanup with OutOfMemoryErrors

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
      Show
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.

      Description

      Obesrved a task with OutOfMemory error, stuck in cleanup.

      1. MAPREDUCE-430-v1.8.patch
        8 kB
        Amar Kamat
      2. MAPREDUCE-430-v1.7.patch
        6 kB
        Amar Kamat
      3. MAPREDUCE-430-v1.6-branch-0.20.patch
        12 kB
        Amar Kamat
      4. MAPREDUCE-430-v1.6.patch
        12 kB
        Amar Kamat
      5. MAPREDUCE-430-v1.13-branch-0.20.patch
        18 kB
        Amar Kamat
      6. MAPREDUCE-430-v1.13.patch
        18 kB
        Amar Kamat
      7. MAPREDUCE-430-v1.12-branch-0.20.patch
        18 kB
        Amar Kamat
      8. MAPREDUCE-430-v1.12.patch
        18 kB
        Amar Kamat
      9. MAPREDUCE-430-v1.11.patch
        18 kB
        Amar Kamat
      10. MAPREDUCE-430.FI.patch
        0.6 kB
        Konstantin Boudnik
      11. MAPRED-430-v1.13-example.patch
        3 kB
        Amar Kamat

        Activity

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Amareshwari Sriramadasu
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development