[CHUKWA-575] Cluster Summarization script

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: Scripts

Environment

Java 6, Mac OS X 10.6

• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 01/Jan/11 01:59
• Updated: 23/Jan/11 20:57
• Resolved: 23/Jan/11 20:57

Description

Chukwa record metrics from name node, data node, job tracker, task tracker, etc, but the raw metrics does not help determine all aspect of the cluster health. For now, we have the following metrics in HBase:

• System
• Disk
• Memory
• Network
• HDFS
• Name Node
• Data Node
• Map Reduce
• Job Tracker
• Task Tracker

We can further analyze the data to provide a summary for the cluster as these categories:

• System - Performance profile of how busy the nodes are in the cluster
• HDFS - Capacity of the disk storage, and health of the data in the file system
• MapReduce - Capacity of the processing pipeline, and health of the processing system