Hadoop Common
  1. Hadoop Common
  2. HADOOP-2947

[HOD] Hod should redirect stderr and stdout of Hadoop daemons to assist debugging

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.16.0
    • Fix Version/s: 0.17.0
    • Component/s: contrib/hod
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.

      Description

      Copied from internal bug details from Koji:

      ==========================
      Sometimes JobTracker/TaskTracker starts consuming 99% cpu and stops responding to 'jstack' call. In those cases,
      usually it still responds to kill -QUIT signal which forces the jvm to dump the stack to stdout.

      Please have the stdout of JT/TT redirected to a file.

      Adding stderr.
      If thread has an uncaught exception, it prints out to stderr and dies.
      ==========================

      1. HADOOP-2947.4
        7 kB
        Vinod Kumar Vavilapalli
      2. HADOOP-2947.3
        7 kB
        Vinod Kumar Vavilapalli
      3. HADOOP-2947.2
        6 kB
        Vinod Kumar Vavilapalli
      4. HADOOP-2947
        12 kB
        Vinod Kumar Vavilapalli

        Activity

        Hemanth Yamijala created issue -
        Hemanth Yamijala made changes -
        Field Original Value New Value
        Assignee Vinod Kumar Vavilapalli [ vinodkv ]
        Vinod Kumar Vavilapalli made changes -
        Attachment HADOOP-2947 [ 12378113 ]
        Vinod Kumar Vavilapalli made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hemanth Yamijala made changes -
        Fix Version/s 0.17.0 [ 12312913 ]
        Hemanth Yamijala made changes -
        Fix Version/s 0.17.0 [ 12312913 ]
        Priority Major [ 3 ] Blocker [ 1 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment HADOOP-2947.2 [ 12378917 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment HADOOP-2947.3 [ 12379006 ]
        Vinod Kumar Vavilapalli made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment HADOOP-2947.4 [ 12379020 ]
        Vinod Kumar Vavilapalli made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hemanth Yamijala made changes -
        Resolution Fixed [ 1 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hemanth Yamijala made changes -
        Hadoop Flags [Reviewed]
        Release Note The stdout and stderr streams of daemons are redirected to files that are created under the hadoop log directory. Users can now send kill 3 signals to the daemons to get stack traces and thread dumps for debugging.
        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Vinod Kumar Vavilapalli
            Reporter:
            Hemanth Yamijala
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development