Hadoop Common
  1. Hadoop Common
  2. HADOOP-1857

Ability to run a script when a task fails to capture stack traces

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.16.0
    • Component/s: None
    • Labels:
      None

      Description

      This basically is for providing a better user interface for debugging failed
      jobs. Today we see stack traces for failed tasks on the job ui if the job
      happened to be a Java MR job. For non-Java jobs like Streaming, Pipes, the
      diagnostic info on the job UI is not helpful enough to debug what might have
      gone wrong. They are usually framework traces and not app traces.
      We want to be able to provide a facility, via user-provided scripts, for doing
      post-processing on task logs, input, output, etc. There should be some default
      scripts like running core dumps under gdb for locating illegal instructions,
      the last few lines from stderr, etc. These outputs could be sent to the
      tasktracker and in turn to the jobtracker which would then display it on the
      job UI on demand.

      1. patch-1857.txt
        53 kB
        Amareshwari Sriramadasu
      2. patch-1857.txt
        53 kB
        Amareshwari Sriramadasu
      3. patch-1857.txt
        53 kB
        Amareshwari Sriramadasu
      4. patch-1857.txt
        53 kB
        Amareshwari Sriramadasu
      5. tt-no-warn.patch
        11 kB
        Owen O'Malley
      6. patch-1857.txt
        37 kB
        Amareshwari Sriramadasu
      7. patch-1857.txt
        36 kB
        Amareshwari Sriramadasu
      8. patch-1857.txt
        36 kB
        Amareshwari Sriramadasu
      9. patch-1857.txt
        36 kB
        Amareshwari Sriramadasu
      10. patch-1857.txt
        36 kB
        Amareshwari Sriramadasu
      11. patch-1857.txt
        39 kB
        Amareshwari Sriramadasu
      12. patch-1857.txt
        39 kB
        Amareshwari Sriramadasu

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Amareshwari Sriramadasu
            Reporter:
            Amareshwari Sriramadasu
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development