Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2947

[HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.16.0
    • Fix Version/s: 0.17.0
    • Component/s: contrib/hod
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.

      Description

      Copied from internal bug details from Koji:

      ==========================
      Sometimes JobTracker/TaskTracker starts consuming 99% cpu and stops responding to 'jstack' call. In those cases,
      usually it still responds to kill -QUIT signal which forces the jvm to dump the stack to stdout.

      Please have the stdout of JT/TT redirected to a file.

      Adding stderr.
      If thread has an uncaught exception, it prints out to stderr and dies.
      ==========================

        Attachments

        1. HADOOP-2947
          12 kB
          Vinod Kumar Vavilapalli
        2. HADOOP-2947.2
          6 kB
          Vinod Kumar Vavilapalli
        3. HADOOP-2947.3
          7 kB
          Vinod Kumar Vavilapalli
        4. HADOOP-2947.4
          7 kB
          Vinod Kumar Vavilapalli

          Activity

            People

            • Assignee:
              vinodkv Vinod Kumar Vavilapalli
              Reporter:
              yhemanth Hemanth Yamijala
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: