Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9618

Add thread which detects JVM pauses

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.3.0
    • util
    • None

    Description

      Often times users struggle to understand what happened when a long JVM pause (GC or otherwise) causes things to malfunction inside a Hadoop daemon. For example, a long GC pause while logging an edit to the QJM may cause the edit to timeout, or a long GC pause may make other IPCs to the NameNode timeout. We should add a simple thread which loops on 1-second sleeps, and if the sleep ever takes significantly longer than 1 second, log a WARN. This will make GC pauses obvious in logs.

      Attachments

        1. hadoop-9618.txt
          10 kB
          Todd Lipcon

        Issue Links

        relates to

        New Feature - A new feature of the product, which has yet to be developed. HBASE-9630 Add thread which detects JVM pauses like HADOOP's

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6443 Add JvmPauseMonitor to Job History Server

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. YARN-4019 Add JvmPauseMonitor to ResourceManager and NodeManager

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. YARN-4031 Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. OOZIE-1826 Add thread which detects JVM pauses

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            28 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment