[CHUKWA-667] Optimize the HBase schema for Ganglia queris

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6.0
• Fix Version/s: 0.7.0
• Component/s: Data Processors
• Assignee: Eric Yang
• Reporter: Saisai Shao
• Created: 15/Oct/12 08:39
• Updated: 18/Apr/15 05:14
• Resolved: 18/Apr/15 05:14

Description

Chukwa HBase table schema is designed for HICC, it cannot be fully adapted to Ganglia web frontend for several reasons:
(1) cannot fastly retrieve all the cluster and related host names.
(2) system metrics have no attributes, like type, unit, so it is hard to explain the collected metrics by code.
(3) lack of data cosolidate function, choosing metric for a large time range (like 30 days) will fetch all the data and draw graph, which will largely lose performance.

We will redesign the table schema that will be better adapted to Ganglia web frontend queries.

Issue Links

• incorporates: CHUKWA-744 Refactor ETL process for HBaseWriter