Hadoop Common
  1. Hadoop Common
  2. HADOOP-2947

[HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.16.0
    • Fix Version/s: 0.17.0
    • Component/s: contrib/hod
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.

      Description

      Copied from internal bug details from Koji:

      ==========================
      Sometimes JobTracker/TaskTracker starts consuming 99% cpu and stops responding to 'jstack' call. In those cases,
      usually it still responds to kill -QUIT signal which forces the jvm to dump the stack to stdout.

      Please have the stdout of JT/TT redirected to a file.

      Adding stderr.
      If thread has an uncaught exception, it prints out to stderr and dies.
      ==========================

      1. HADOOP-2947
        12 kB
        Vinod Kumar Vavilapalli
      2. HADOOP-2947.2
        6 kB
        Vinod Kumar Vavilapalli
      3. HADOOP-2947.3
        7 kB
        Vinod Kumar Vavilapalli
      4. HADOOP-2947.4
        7 kB
        Vinod Kumar Vavilapalli

        Activity

          People

          • Assignee:
            Vinod Kumar Vavilapalli
            Reporter:
            Hemanth Yamijala
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development