Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-430

Task stuck in cleanup with OutOfMemoryErrors

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
      Show
      Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.

      Description

      Obesrved a task with OutOfMemory error, stuck in cleanup.

      1. MAPREDUCE-430-v1.8.patch
        8 kB
        Amar Kamat
      2. MAPREDUCE-430-v1.7.patch
        6 kB
        Amar Kamat
      3. MAPREDUCE-430-v1.6-branch-0.20.patch
        12 kB
        Amar Kamat
      4. MAPREDUCE-430-v1.6.patch
        12 kB
        Amar Kamat
      5. MAPREDUCE-430-v1.13-branch-0.20.patch
        18 kB
        Amar Kamat
      6. MAPREDUCE-430-v1.13.patch
        18 kB
        Amar Kamat
      7. MAPREDUCE-430-v1.12-branch-0.20.patch
        18 kB
        Amar Kamat
      8. MAPREDUCE-430-v1.12.patch
        18 kB
        Amar Kamat
      9. MAPREDUCE-430-v1.11.patch
        18 kB
        Amar Kamat
      10. MAPREDUCE-430.FI.patch
        0.6 kB
        Konstantin Boudnik
      11. MAPRED-430-v1.13-example.patch
        3 kB
        Amar Kamat

        Activity

        Amareshwari Sriramadasu created issue -
        Owen O'Malley made changes -
        Field Original Value New Value
        Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
        Key HADOOP-6088 MAPREDUCE-430
        Component/s mapred [ 12310690 ]
        Fix Version/s 0.21.0 [ 12313563 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.6.patch [ 12412712 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.6-branch-0.20.patch [ 12413283 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.20.1 [ 12314047 ]
        Resolution Fixed [ 1 ]
        Sharad Agarwal made changes -
        Assignee Amar Kamat [ amar_kamat ]
        Sharad Agarwal made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.7.patch [ 12416767 ]
        Amar Kamat made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Hadoop Flags [Reviewed]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.8.patch [ 12416988 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.11.patch [ 12417451 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.12.patch [ 12417476 ]
        Attachment MAPREDUCE-430-v1.12-branch-0.20.patch [ 12417477 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.13.patch [ 12417714 ]
        Amar Kamat made changes -
        Attachment MAPREDUCE-430-v1.13-branch-0.20.patch [ 12417729 ]
        Sharad Agarwal made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Amar Kamat made changes -
        Attachment MAPRED-430-v1.13-example.patch [ 12417751 ]
        Amar Kamat made changes -
        Release Note Various code paths in the framework caught Throwable and tried to do inline cleanup. In case of OOM errors, such inline-cleanups can result into hung jvms. With this fix, the TaskTracker provides a api to report fatal errors (any throwable other than FSErrror and Exceptions). On catching a Throwable, Mapper/Reducer tries to inform the TT.
        Konstantin Boudnik made changes -
        Attachment MAPREDUCE-430.FI.patch [ 12417893 ]

          People

          • Assignee:
            Amar Kamat
            Reporter:
            Amareshwari Sriramadasu
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development