Uploaded image for project: 'Ambari (Retired)'
  1. Ambari (Retired)
  2. AMBARI-5707

Replace Ganglia with high performance and pluggable Metrics System

Details

    • Epic
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.6.0
    • 2.0.0
    • ambari-agent, ambari-server
    • None
    • Ambari Metrics System

    Description

      Ambari Metrics System

      • Ability to collect metrics from Hadoop and other Stack services
      • Ability to retain metrics at a high precision for a configurable time period (say 5 days)
      • Ability to automatically purge metrics after retention period
      • At collection time, provide clear integration point for external system (such as TSDB)
      • At purge time, provide clear integration point for metrics retention by external system
      • Should provide default options for external metrics retention (say “HDFS”)
      • Provide tools / utilities for analyzing metrics in retention system (say “Hive schema, Pig scripts, etc” that can be used with the default retention store “HDFS”)

      System Requirements

      • Must be portable and platform independent
      • Must not conflict with any existing metrics system (such as Ganglia)
      • Must not conflict with existing SNMP infra
      • Must not run as root
      • Must have HA story (no SPOF)

      Usage

      • Ability to obtain metrics from Ambari REST API (point in time and temporal)
      • Ability to view metric graphs in Ambari Web (currently, fixed)
      • Ability to configure custom metric graphs in Ambari Web (currently, we have metric graphs “fixed” into the UI)
      • Need to improve metric graph “navigation” in Ambari Web (currently, metric graphs do not allow navigation at arbitrary timeframes, but only at ganglia aggregation intervals)
      • Ability to “view cluster” at point in time (i.e. see all metrics at that point)
      • Ability to define metrics (and how + where to obtain) in Stack Definitions

      Attachments

        1. MetricsArchLatest.png
          197 kB
          Siddharth Wagle
        2. Revised archtecture diagram.png
          351 kB
          Siddharth Wagle

        Issue Links

          Issues in epic

            Activity

              People

                swagle Siddharth Wagle
                swagle Siddharth Wagle
                Votes:
                4 Vote for this issue
                Watchers:
                27 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  Slack

                    Issue deployment