[CHUKWA-278] Improve post process manager and metric data loader to support data loading from pig aggregation

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.2.0
• Component/s: Data Processors

Environment

Redhat EL 5.1, Java 6

• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 08/Jun/09 21:46
• Updated: 11/Jun/09 15:13
• Resolved: 10/Jun/09 22:12

Description

The current post process manager loads sequence file to database only. Ideally, the post process manager should be able to load data into different data loader. Hence, DataLoaderFactory should be defined as an interface or abstract class for third party to implement their own data loader. The current implementation of pig aggregator generates down sampled data as different record type. There should be a new capability for Metric Data Loader to identify table partition base on record type.