Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2947

[HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.16.0
    • 0.17.0
    • contrib/hod
    • None
    • Reviewed
    • The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.

    Description

      Copied from internal bug details from Koji:

      ==========================
      Sometimes JobTracker/TaskTracker starts consuming 99% cpu and stops responding to 'jstack' call. In those cases,
      usually it still responds to kill -QUIT signal which forces the jvm to dump the stack to stdout.

      Please have the stdout of JT/TT redirected to a file.

      Adding stderr.
      If thread has an uncaught exception, it prints out to stderr and dies.
      ==========================

      Attachments

        1. HADOOP-2947.4
          7 kB
          Vinod Kumar Vavilapalli
        2. HADOOP-2947.3
          7 kB
          Vinod Kumar Vavilapalli
        3. HADOOP-2947.2
          6 kB
          Vinod Kumar Vavilapalli
        4. HADOOP-2947
          12 kB
          Vinod Kumar Vavilapalli

        Activity

          People

            vinodkv Vinod Kumar Vavilapalli
            yhemanth Hemanth Yamijala
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: