Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-430

Task stuck in cleanup with OutOfMemoryErrors

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
      Show
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.

      Description

      Obesrved a task with OutOfMemory error, stuck in cleanup.

        Attachments

        1. MAPRED-430-v1.13-example.patch
          3 kB
          Amar Kamat
        2. MAPREDUCE-430.FI.patch
          0.6 kB
          Konstantin Boudnik
        3. MAPREDUCE-430-v1.11.patch
          18 kB
          Amar Kamat
        4. MAPREDUCE-430-v1.12.patch
          18 kB
          Amar Kamat
        5. MAPREDUCE-430-v1.12-branch-0.20.patch
          18 kB
          Amar Kamat
        6. MAPREDUCE-430-v1.13.patch
          18 kB
          Amar Kamat
        7. MAPREDUCE-430-v1.13-branch-0.20.patch
          18 kB
          Amar Kamat
        8. MAPREDUCE-430-v1.6.patch
          12 kB
          Amar Kamat
        9. MAPREDUCE-430-v1.6-branch-0.20.patch
          12 kB
          Amar Kamat
        10. MAPREDUCE-430-v1.7.patch
          6 kB
          Amar Kamat
        11. MAPREDUCE-430-v1.8.patch
          8 kB
          Amar Kamat

          Activity

            People

            • Assignee:
              amar_kamat Amar Kamat
              Reporter:
              amareshwari Amareshwari Sriramadasu
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: