Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2
    • Fix Version/s: 0.23.0, 0.24.0
    • Component/s: metrics
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      JVM metrics published to Ganglia now include the process name as part of the gmetric name.

      Description

      Ganglia jvm metrics don't make sense because it's not clear which java process the metrics refer to. In fact, all hadoop java processes running on a node report their jvm metrics to the same namespace.

      The metrics are exposed by the "jvm" context in JvmMetrics.java. This leads to confusing and nonsensical graphs in ganglia and maybe other monitoring tools.

      One way to fix this is to make sure the process name is reported in the jvm context, making it clear which process is associated with the context, and separating out the jvm metrics per process.

      This is marked as an "incompatible change" because the fix provided removes the JVM metrics and replaces it with process-specific metrics.

      1. ASF.LICENSE.NOT.GRANTED--screenshot-1.jpg
        167 kB
        Jeff Bean
      2. HADOOP-7507v1.patch
        2 kB
        Alejandro Abdelnur
      3. HADOOP-7507-v2.patch
        2 kB
        Michael Katzenellenbogen
      4. HADOOP-7507v3.patch
        2 kB
        Alejandro Abdelnur
      5. HADOOP-7507v4.patch
        3 kB
        Alejandro Abdelnur
      6. HADOOP-7507v5.patch
        3 kB
        Alejandro Abdelnur
      7. HADOOP-7507v6.patch
        9 kB
        Alejandro Abdelnur
      8. HADOOP-7507v7.patch
        9 kB
        Alejandro Abdelnur
      9. hadoop-metrics.properties
        2 kB
        Jeff Bean
      10. JvmMetrics.java
        7 kB
        Jeff Bean

        Activity

        Jeff Bean created issue -
        Jeff Bean made changes -
        Field Original Value New Value
        Attachment hadoop-metrics.properties [ 12489218 ]
        Attachment JvmMetrics.java [ 12489219 ]
        Jeff Bean made changes -
        Attachment screenshot-1.jpg [ 12489220 ]
        Alejandro Abdelnur made changes -
        Assignee Alejandro Abdelnur [ tucu00 ]
        Alejandro Abdelnur made changes -
        Attachment HADOOP-7507v1.patch [ 12490307 ]
        Alejandro Abdelnur made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Michael Katzenellenbogen made changes -
        Attachment HADOOP-7507-v2.patch [ 12490506 ]
        Alejandro Abdelnur made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Alejandro Abdelnur made changes -
        Attachment HADOOP-7507v3.patch [ 12491713 ]
        Alejandro Abdelnur made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.23.0 [ 12315569 ]
        Alejandro Abdelnur made changes -
        Attachment HADOOP-7507v4.patch [ 12492109 ]
        Alejandro Abdelnur made changes -
        Attachment HADOOP-7507v5.patch [ 12492641 ]
        Alejandro Abdelnur made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Alejandro Abdelnur made changes -
        Attachment HADOOP-7507v6.patch [ 12492679 ]
        Alejandro Abdelnur made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Alejandro Abdelnur made changes -
        Fix Version/s 0.24.0 [ 12317652 ]
        Alejandro Abdelnur made changes -
        Attachment HADOOP-7507v7.patch [ 12493507 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Incompatible change] [Incompatible change, Reviewed]
        Resolution Fixed [ 1 ]
        Todd Lipcon made changes -
        Release Note JVM metrics published to Ganglia now include the process name as part of the gmetric name.
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Alejandro Abdelnur
            Reporter:
            Jeff Bean
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development